-- Logs begin at Mon 2022-07-18 07:51:21 UTC, end at Mon 2022-07-18 09:09:48 UTC. -- Jul 18 08:23:37.533911 dv-cinder-850142-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 08:23:37.543184 dv-cinder-850142-3-smb devstack@keystone.service[80313]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 08:23:37 2022] *** Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: nodename: dv-cinder-850142-3-smb Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: machine: x86_64 Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: clock source: unix Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: pcre jit disabled Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: detected number of CPU cores: 4 Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: current working directory: / Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: detected binary path: /usr/bin/uwsgi-core Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: your processes number limit is 47680 Jul 18 08:23:37.545999 dv-cinder-850142-3-smb devstack@keystone.service[80313]: your memory page size is 4096 bytes Jul 18 08:23:37.546646 dv-cinder-850142-3-smb devstack@keystone.service[80313]: detected max file descriptor number: 2048 Jul 18 08:23:37.546646 dv-cinder-850142-3-smb devstack@keystone.service[80313]: lock engine: pthread robust mutexes Jul 18 08:23:37.546646 dv-cinder-850142-3-smb devstack@keystone.service[80313]: thunder lock: enabled Jul 18 08:23:37.546646 dv-cinder-850142-3-smb devstack@keystone.service[80313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 08:23:37.546646 dv-cinder-850142-3-smb devstack@keystone.service[80313]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 08:23:37.589072 dv-cinder-850142-3-smb devstack@keystone.service[80313]: Python main interpreter initialized at 0x557779b789c0 Jul 18 08:23:37.589072 dv-cinder-850142-3-smb devstack@keystone.service[80313]: python threads support enabled Jul 18 08:23:37.589072 dv-cinder-850142-3-smb devstack@keystone.service[80313]: your server socket listen backlog is limited to 100 connections Jul 18 08:23:37.589072 dv-cinder-850142-3-smb devstack@keystone.service[80313]: your mercy for graceful operations on workers is 90 seconds Jul 18 08:23:37.589472 dv-cinder-850142-3-smb devstack@keystone.service[80313]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 08:23:37.589549 dv-cinder-850142-3-smb devstack@keystone.service[80313]: *** Operational MODE: preforking *** Jul 18 08:23:37.589804 dv-cinder-850142-3-smb devstack@keystone.service[80313]: *** uWSGI is running in multiple interpreter mode *** Jul 18 08:23:37.589804 dv-cinder-850142-3-smb devstack@keystone.service[80313]: spawned uWSGI master process (pid: 80313) Jul 18 08:23:37.590015 dv-cinder-850142-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 08:23:37.591739 dv-cinder-850142-3-smb devstack@keystone.service[80313]: spawned uWSGI worker 1 (pid: 80327, cores: 1) Jul 18 08:23:37.591739 dv-cinder-850142-3-smb devstack@keystone.service[80313]: spawned uWSGI worker 2 (pid: 80328, cores: 1) Jul 18 08:23:37.591739 dv-cinder-850142-3-smb devstack@keystone.service[80313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 08:23:43.129805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:23:43.129805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: from cryptography.utils import int_from_bytes Jul 18 08:23:43.130650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:23:43.130650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: from cryptography.utils import int_from_bytes Jul 18 08:23:43.131059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:23:43.131059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: from cryptography.utils import int_from_bytes Jul 18 08:23:43.131166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:23:43.131166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: from cryptography.utils import int_from_bytes Jul 18 08:23:43.180325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 08:23:43.180503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 08:23:43.180587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 08:23:43.180673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 08:23:43.180750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] command line args: [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 08:23:43.180826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] command line args: [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 08:23:43.180978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 08:23:43.181063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 08:23:43.181139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ================================================================================ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 08:23:43.181215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ================================================================================ {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 08:23:43.181395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] admin_token = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.181486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] admin_token = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.181637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] config_dir = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.181764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config_dir = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.181849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.181927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] config_source = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config_source = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] debug = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] debug = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182831 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.182932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] list_limit = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.183943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] log_config_append = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_config_append = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_dir = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] log_dir = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] log_file = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.184921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.185988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.186945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.187913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] publish_errors = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] publish_errors = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188769 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.188992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] standard_threads = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] standard_threads = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.189999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_journal = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_json = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] use_journal = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.190966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_stderr = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.191043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] use_json = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.191155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_syslog = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.191241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] use_stderr = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.191241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] use_syslog = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.191511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.191612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:23:43.191697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.191763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.191833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.191897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.192929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.193989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.194891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.195871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.196858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.197845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.198959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.199042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.199186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.199281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.199420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.199985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.200187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.200266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.200425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.200532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.200661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.200738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.200906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.201117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.201257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.201424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.201597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.201782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.201984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.202225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.202444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.202658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.202872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.203081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.203296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.203515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.203709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.203924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.204056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.204180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.204339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.204465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.204608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.204732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.204878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.205901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.210228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.210395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.210555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.210678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.210796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.210924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.211996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.212927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.213148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.213260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.213393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.213518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.213629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.213867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.214900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.215012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.215158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.215816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.215945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216769 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.216880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.217939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.218990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.219947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.220902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.221917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.222899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] auth.external = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.external = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.223983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.224107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.224279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.224279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] auth.password = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.224517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.224636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] auth.token = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.224765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.224892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.password = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.token = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.225943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.226167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.226293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.226417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.226532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] credential.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.226648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.226779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.226893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.227970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.228901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.229217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.229217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.229443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.229561 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.229698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.229841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.229955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.230946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.231160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.231281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.231413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.231527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.231639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.231765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.231887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.232938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.233927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.234025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.234124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.238597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.238714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.238796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.238858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.238929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.239919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.240982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.241934 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242079 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.242913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.243985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.244937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.245980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.246913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.247969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.248963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.249951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.250895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.251988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] role.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.252943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] role.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.253996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.254951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.255963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256250 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256679 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.256962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.257982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258077 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.258931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.259988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.260946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.261909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.262602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.262768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.262927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263343 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.connection = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.263932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.264892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.265876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.266994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.267927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.268006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.268079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 08:23:43.268152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.268395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.268640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.268880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.269132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.269371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.269624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.269889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.270135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.270374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:23:43.270547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 08:23:43.299973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.300200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.300424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.300859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.301100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.301327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.308900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.309846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.337538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.337789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.338275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.338516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.482984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.483163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.533452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.533572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.533705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.533791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.599776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.600871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.601002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.601166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.626758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.627905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.628037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.628121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.628253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.639439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.639758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.652117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.652350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.652462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.653135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.653226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.653366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.653540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.653634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.653797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.653918 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.654002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.654145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.654242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.654364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 08:23:43.672129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.672341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 08:23:43.672680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.672881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 08:23:43.672983 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.673150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.673234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 08:23:43.673414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.673495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.673699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.673784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 08:23:43.673958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.674040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.674235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.674506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.674770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.685127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.685405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.685697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.685973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.686072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.686254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.686527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.686813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.694101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.694983 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.697380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.697661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.697967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.698302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.698386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.698588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.698672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.698873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.698957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.699160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.699253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.699608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.699709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.699787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.699862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.700018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.700210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.700292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.700368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.700605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.700881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.701167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.727205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.728496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.728832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.729114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.730163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.730447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.735078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.735309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.735591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.736378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.736662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.736949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.742922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.743472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.744578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.744865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.748148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.748433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.748713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.748995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.749270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.749546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.749720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.749848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.750018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.750101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.750306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.750592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.750869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.751145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.751422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.751715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.769031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.769308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.770562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.770844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.774053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.775472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.778354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.778354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.779688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.791659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.791748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.791839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.791905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.791990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.792075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.792075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.792075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.792075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.792075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.792414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.792669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.792971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.793880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.794174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.794468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.794759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.812226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.812609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.812881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.813152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.813867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.814249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.814524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.814800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.821120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.822783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.822868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.823129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.824584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.824981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.826234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.826528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.826819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.827100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.827389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.828094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.828379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.828670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.828956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.829255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.841582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.841892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.842177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.842460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.842744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.843036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.843312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.843912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.844228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.844533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.844840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.845127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.845418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.845719 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.863322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.866236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.866651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.869897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.870260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.871900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.873263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.873547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.873864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.874150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.874987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.876647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.877017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.877217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.881582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.883228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.884698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.886390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.886579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.886869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.887784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.888072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.890308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.890608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.890898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.891178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.897334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.897619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.897922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.900512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.900805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.901090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.906793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.907076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.907357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.907645 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.907921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.908216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.908490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.908756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.909029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.909297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.909560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 08:23:43.909650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.909868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.909958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.910133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.910214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.910404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.910500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.910687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.910982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.911258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.911526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.911801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.912107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.912369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.912642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.912909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.913197 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 08:23:43.948495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557779b789c0 pid: 80328 (default app) Jul 18 08:23:43.951994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557779b789c0 pid: 80327 (default app) Jul 18 08:23:43.952557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8dca4-db18-477b-9a81-4168a71023e1 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:43.952856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8dca4-db18-477b-9a81-4168a71023e1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:43.953138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8dca4-db18-477b-9a81-4168a71023e1 None None] PATH_INFO: `/v3` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:43.957359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Mon Jul 18 08:23:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:23:52.553504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f0cb-41ea-419c-a800-4df933bb9ed7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:52.554093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f0cb-41ea-419c-a800-4df933bb9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:52.554093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f0cb-41ea-419c-a800-4df933bb9ed7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:52.559021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:23:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:23:52.564736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:52.565163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:52.565288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:52.634400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: INFO dbcounter [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] Registered counter for database keystone Jul 18 08:23:52.656381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG oslo_db.sqlalchemy.engines [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:23:52.662649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writer thread running {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:23:52.845264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG passlib.handlers.bcrypt [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80328) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 08:23:52.845708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG passlib.handlers.bcrypt [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80328) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 08:23:52.904015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:23:52.905738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:23:53.034624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:23:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 08:23:53.071781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f0cb-41ea-419c-a800-4df933bb9ed7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:53.142298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: INFO dbcounter [None req-ab88f0cb-41ea-419c-a800-4df933bb9ed7 None None] Registered counter for database keystone Jul 18 08:23:53.161565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG oslo_db.sqlalchemy.engines [None req-ab88f0cb-41ea-419c-a800-4df933bb9ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:23:53.168317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writer thread running {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:23:53.295268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f0cb-41ea-419c-a800-4df933bb9ed7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:53.299497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb256-0945-4b7d-bfe2-b3c8bc4d780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:53.300157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb256-0945-4b7d-bfe2-b3c8bc4d780e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:53.300443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb256-0945-4b7d-bfe2-b3c8bc4d780e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:53.300718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb256-0945-4b7d-bfe2-b3c8bc4d780e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:53.310212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb256-0945-4b7d-bfe2-b3c8bc4d780e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:53.372173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28bcb256-0945-4b7d-bfe2-b3c8bc4d780e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 08:23:53.372513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb256-0945-4b7d-bfe2-b3c8bc4d780e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:53.382967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Jul 18 08:23:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 08:23:53.389971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:53.405064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9f0f-fb90-4796-87cf-1e16dde4589c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:53.409467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5747e8d-133a-463c-9817-fbb047d236ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:53.410670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5747e8d-133a-463c-9817-fbb047d236ae admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:53.410957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5747e8d-133a-463c-9817-fbb047d236ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:53.411236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5747e8d-133a-463c-9817-fbb047d236ae admin admin] PATH_INFO: `/v3/projects/ab95a2af933c40dba08b776a8568e994` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:53.415453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5747e8d-133a-463c-9817-fbb047d236ae admin admin] RBAC: Authorizing `identity:get_project(project_id=ab95a2af933c40dba08b776a8568e994)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:53.467388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5747e8d-133a-463c-9817-fbb047d236ae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 08:23:53.467730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5747e8d-133a-463c-9817-fbb047d236ae admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:53.472601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Mon Jul 18 08:23:53 2022] GET /identity/v3/projects/ab95a2af933c40dba08b776a8568e994 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:23:55.498047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac803d-4212-45d8-8469-85017f1dec9d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:55.498583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac803d-4212-45d8-8469-85017f1dec9d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:55.498583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac803d-4212-45d8-8469-85017f1dec9d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:55.502754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:23:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:23:55.508747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f462-fb56-4d96-b7f8-60c07b8a0393 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:55.509205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f462-fb56-4d96-b7f8-60c07b8a0393 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:55.509398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f462-fb56-4d96-b7f8-60c07b8a0393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:55.530196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c7e3f462-fb56-4d96-b7f8-60c07b8a0393 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:23:55.531779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c7e3f462-fb56-4d96-b7f8-60c07b8a0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:23:55.539836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:23:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 08:23:55.563143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac803d-4212-45d8-8469-85017f1dec9d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:55.576115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac803d-4212-45d8-8469-85017f1dec9d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:55.580438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4be07-996b-4163-9559-aa24f668daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:55.581165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4be07-996b-4163-9559-aa24f668daa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:55.581504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4be07-996b-4163-9559-aa24f668daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:55.581883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4be07-996b-4163-9559-aa24f668daa9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:55.590379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4be07-996b-4163-9559-aa24f668daa9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:55.592265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4be07-996b-4163-9559-aa24f668daa9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:55.601861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Jul 18 08:23:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:23:55.608012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3f462-fb56-4d96-b7f8-60c07b8a0393 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:55.618220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3f462-fb56-4d96-b7f8-60c07b8a0393 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:55.623321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1e5b2-df55-405e-b584-7b77ba8afc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:55.624205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1e5b2-df55-405e-b584-7b77ba8afc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:55.624487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1e5b2-df55-405e-b584-7b77ba8afc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:55.624764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1e5b2-df55-405e-b584-7b77ba8afc5a admin admin] PATH_INFO: `/v3/users/ab4196857ae341bbac204680cc59c0f9` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:55.626235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1e5b2-df55-405e-b584-7b77ba8afc5a admin admin] RBAC: Authorizing `identity:get_user(user_id=ab4196857ae341bbac204680cc59c0f9)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:55.628085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1e5b2-df55-405e-b584-7b77ba8afc5a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:55.629724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Mon Jul 18 08:23:55 2022] GET /identity/v3/users/ab4196857ae341bbac204680cc59c0f9 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:23:57.789568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed988a7-1da9-4f97-9718-fcd6d34fbde7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:57.790115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed988a7-1da9-4f97-9718-fcd6d34fbde7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:57.790542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed988a7-1da9-4f97-9718-fcd6d34fbde7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:57.794145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:23:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:23:57.800108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641d3-7136-4fac-95fc-63ea0d4e3866 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:57.800893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641d3-7136-4fac-95fc-63ea0d4e3866 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:57.800893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641d3-7136-4fac-95fc-63ea0d4e3866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:57.811181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a5f3d-0a0f-42b8-a8d4-c7cf5b59f236 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:57.811689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a5f3d-0a0f-42b8-a8d4-c7cf5b59f236 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:57.812201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a5f3d-0a0f-42b8-a8d4-c7cf5b59f236 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:57.814832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:23:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:23:57.819418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d08641d3-7136-4fac-95fc-63ea0d4e3866 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:23:57.820649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d08641d3-7136-4fac-95fc-63ea0d4e3866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:23:57.823253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:57.824107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:57.824568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:57.872773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG passlib.handlers.bcrypt [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80327) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 08:23:57.873194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG passlib.handlers.bcrypt [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80327) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 08:23:57.913890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:23:57.919590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:23:57.921240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:23:57.938039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08641d3-7136-4fac-95fc-63ea0d4e3866 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:57.966711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:23:58.046526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:23:58.060736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08641d3-7136-4fac-95fc-63ea0d4e3866 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.076992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:58.100653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.101466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.101783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.102074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.115441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:23:58.128800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:23:58.130535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:23:58.132370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:23:58.136780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:58.193584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8713b-142b-4016-8377-781e09d1de22 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.197453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:23:58.227874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:23:58.235534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.236529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.236863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.237188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.247973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7d0a6-44c4-426e-a87c-4050271e5554 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.284277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.284960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.285245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.285530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.286323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:23:58.286629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:58.288085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:58.302586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:23:58.308947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:58.315236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:58.316881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:58.442095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:23:58.452823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:58.457463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:23:58.461532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a879b-0c6c-47c7-b63f-a5833fe701e7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.518467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.520624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.521291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.521530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] PATH_INFO: `/v3/users/ab4196857ae341bbac204680cc59c0f9` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.523417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] RBAC: Authorizing `identity:get_user(user_id=ab4196857ae341bbac204680cc59c0f9)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:58.525155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:58.527693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:23:58 2022] GET /identity/v3/users/ab4196857ae341bbac204680cc59c0f9 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:23:58.533491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:58.556093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:23:58.602724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d19f1b-6d6a-4161-9fd7-0c05e5eb9aa4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.643112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.643924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.644213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.644490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.665155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:58.666716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:58.677248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ba01-0586-43e2-b6a7-a79fcce67151 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:23:58.691981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:23:58.693479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:23:58.695537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:23:58.695537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:23:58.695537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:23:58.695537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:23:58.695537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:23:58.699523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:58.728961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.730614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.731012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.731505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.733008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:58.734612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:58.736416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:23:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:23:58.743923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:23:58.768880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:23:58.824398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf7b8-2f82-4d4a-bde6-ec9b411ec284 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.847263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:23:58.875950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ed9-053e-41d2-a6ff-5d85e6798f48 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:23:58.879231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72c999-544a-4e1f-a7dc-2d8ffa035868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.880097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72c999-544a-4e1f-a7dc-2d8ffa035868 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.880556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72c999-544a-4e1f-a7dc-2d8ffa035868 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.881025 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72c999-544a-4e1f-a7dc-2d8ffa035868 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.881943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72c999-544a-4e1f-a7dc-2d8ffa035868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:23:58.882453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72c999-544a-4e1f-a7dc-2d8ffa035868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:58.884913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72c999-544a-4e1f-a7dc-2d8ffa035868 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:58.917553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:23:58.930363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d883b5f-a197-49b1-b824-a31b3ec375b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:23:58.931132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883b5f-a197-49b1-b824-a31b3ec375b1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:23:58.931487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883b5f-a197-49b1-b824-a31b3ec375b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:23:58.931803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883b5f-a197-49b1-b824-a31b3ec375b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:23:58.932717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d883b5f-a197-49b1-b824-a31b3ec375b1 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.domain.id=default, user.id=ab4196857ae341bbac204680cc59c0f9) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:23:58.933125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d883b5f-a197-49b1-b824-a31b3ec375b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:23:58.934713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d883b5f-a197-49b1-b824-a31b3ec375b1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:23:58.943360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Jul 18 08:23:58 2022] GET /identity/v3/role_assignments?user.id=ab4196857ae341bbac204680cc59c0f9&scope.domain.id=default&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 233 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:01.583180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2e462-135c-47d6-a412-a7112d211cd9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:01.583720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2e462-135c-47d6-a412-a7112d211cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:01.583720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2e462-135c-47d6-a412-a7112d211cd9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:01.585104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:01.599534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeca17-68a2-4fb8-9820-2fc658da42a7 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:01.600026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeca17-68a2-4fb8-9820-2fc658da42a7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:01.600098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeca17-68a2-4fb8-9820-2fc658da42a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:01.619033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-50eeca17-68a2-4fb8-9820-2fc658da42a7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:01.621533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-50eeca17-68a2-4fb8-9820-2fc658da42a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:01.713307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:01.755063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2e462-135c-47d6-a412-a7112d211cd9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:01.767005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed8ed9-de54-463b-bc88-474ca8687db9 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:01.769998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed8ed9-de54-463b-bc88-474ca8687db9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:01.770489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed8ed9-de54-463b-bc88-474ca8687db9 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:01.773794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:01.783201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336b5b-13c5-43d1-abf9-357c3c35958b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:01.783827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336b5b-13c5-43d1-abf9-357c3c35958b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:01.784322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336b5b-13c5-43d1-abf9-357c3c35958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:01.811627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6a336b5b-13c5-43d1-abf9-357c3c35958b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:01.812842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6a336b5b-13c5-43d1-abf9-357c3c35958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:01.992649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2e462-135c-47d6-a412-a7112d211cd9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:02.005507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 14/25] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:02.006918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fb54d-2202-440f-8001-480b5fb9359a None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.007512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fb54d-2202-440f-8001-480b5fb9359a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.007999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fb54d-2202-440f-8001-480b5fb9359a None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.009556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 15/26] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:02.015371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df92dc2-04f3-458b-be08-9c0778debbaa None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.016003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df92dc2-04f3-458b-be08-9c0778debbaa None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.016487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df92dc2-04f3-458b-be08-9c0778debbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.022192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:02.039787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:02.051870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:02.052730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.053028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.053313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.057670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7df92dc2-04f3-458b-be08-9c0778debbaa None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:02.059754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7df92dc2-04f3-458b-be08-9c0778debbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:02.071338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:02.082108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:02.088273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 12/27] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:02.089897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:02.190315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 16/28] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:02.191751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df92dc2-04f3-458b-be08-9c0778debbaa None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:02.197842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78610d-2bb2-4fc0-b314-63510aa9c210 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:02.239453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb260e6-7e49-49ac-b6a3-cfb2a97bb4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:02.240211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb260e6-7e49-49ac-b6a3-cfb2a97bb4a7 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.240697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb260e6-7e49-49ac-b6a3-cfb2a97bb4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.241308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb260e6-7e49-49ac-b6a3-cfb2a97bb4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.243295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb260e6-7e49-49ac-b6a3-cfb2a97bb4a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:02.244961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb260e6-7e49-49ac-b6a3-cfb2a97bb4a7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:02.334911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df92dc2-04f3-458b-be08-9c0778debbaa None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:02.380652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd8d94-1a17-423c-b83b-4004dd1d3873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:02.381341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8d94-1a17-423c-b83b-4004dd1d3873 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.381626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8d94-1a17-423c-b83b-4004dd1d3873 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.381935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8d94-1a17-423c-b83b-4004dd1d3873 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.382706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8d94-1a17-423c-b83b-4004dd1d3873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:02.383013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8d94-1a17-423c-b83b-4004dd1d3873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:02.384447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8d94-1a17-423c-b83b-4004dd1d3873 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:02.387476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:02.401495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 17/29] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:02.403029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e035b4-4548-411c-adea-9492b03fd16f None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.403409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e035b4-4548-411c-adea-9492b03fd16f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.403694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e035b4-4548-411c-adea-9492b03fd16f None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.405219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 18/30] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:02.405857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e035b4-4548-411c-adea-9492b03fd16f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:02.530493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 13/31] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 08:24:02 2022] POST /identity/v3/roles => generated 225 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:02.532480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd413a-40bd-4c78-a15f-da09931de6c6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.533004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd413a-40bd-4c78-a15f-da09931de6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.533494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd413a-40bd-4c78-a15f-da09931de6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.562994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6ecd413a-40bd-4c78-a15f-da09931de6c6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:02.565211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6ecd413a-40bd-4c78-a15f-da09931de6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:02.599463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e035b4-4548-411c-adea-9492b03fd16f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:02.609030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:02.665533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:02.667730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.668238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.668758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.682223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:02.684260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:24:02.707441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:02.708341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:02.709135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:24:02.709135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:24:02.709135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:24:02.709135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:02.709365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 14/32] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:02.709365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd413a-40bd-4c78-a15f-da09931de6c6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:02.719392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 19/33] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:02.726222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:02.828714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:02.901057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be7ab5-b14e-4960-9c09-b1fb78eb84d5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:02.922184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd413a-40bd-4c78-a15f-da09931de6c6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:02.947191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff4a0b-7e2b-465b-89a3-31255994831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:02.947878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4a0b-7e2b-465b-89a3-31255994831e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.948161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4a0b-7e2b-465b-89a3-31255994831e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.948959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4a0b-7e2b-465b-89a3-31255994831e None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.949830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4a0b-7e2b-465b-89a3-31255994831e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:02.950148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4a0b-7e2b-465b-89a3-31255994831e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:02.951603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4a0b-7e2b-465b-89a3-31255994831e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:02.963088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:02.965113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.965512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.965843 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] PATH_INFO: `/v3/users/ab4196857ae341bbac204680cc59c0f9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.967837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] RBAC: Authorizing `identity:get_user(user_id=ab4196857ae341bbac204680cc59c0f9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:02.969502 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:02.971352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 15/34] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:02 2022] GET /identity/v3/users/ab4196857ae341bbac204680cc59c0f9 => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:02.972167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:02.979803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 20/35] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:02.981491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945e3b-6f15-4bfc-bcdb-4c89201c973b None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:02.982035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945e3b-6f15-4bfc-bcdb-4c89201c973b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:02.982478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945e3b-6f15-4bfc-bcdb-4c89201c973b None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:02.984061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 21/36] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:02.989026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24945e3b-6f15-4bfc-bcdb-4c89201c973b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:03.017145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:03.094679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71faa-422a-4155-a686-2a0f38299af6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:03.099007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24945e3b-6f15-4bfc-bcdb-4c89201c973b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:03.108671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:03.129947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045a94d-b625-4b7e-9eab-a8a3b89e40a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:03.130637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045a94d-b625-4b7e-9eab-a8a3b89e40a3 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.130925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045a94d-b625-4b7e-9eab-a8a3b89e40a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.131205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045a94d-b625-4b7e-9eab-a8a3b89e40a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.131964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045a94d-b625-4b7e-9eab-a8a3b89e40a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:03.133464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045a94d-b625-4b7e-9eab-a8a3b89e40a3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:03.134297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:03.135281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.136439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.136720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.138060 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:03.139525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:03.141149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 22/37] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:03.141924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:03.207373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 16/38] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 08:24:02 2022] POST /identity/v3/roles => generated 219 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:03.208860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8fdb-590c-4af0-ae7c-1442d5bbd058 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.209160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8fdb-590c-4af0-ae7c-1442d5bbd058 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.209440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8fdb-590c-4af0-ae7c-1442d5bbd058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.228116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-559b8fdb-590c-4af0-ae7c-1442d5bbd058 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:03.229371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-559b8fdb-590c-4af0-ae7c-1442d5bbd058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:03.264568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd424d6d-fd7a-4a70-a7fd-a8461bcf6c12 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:03.305500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:03.306260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.306611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.306826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.308091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:03.309503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 17/39] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:03.309715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:03.315171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494de8a-1bc3-4925-bcff-f032ca5106fd None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.315489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494de8a-1bc3-4925-bcff-f032ca5106fd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.315737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494de8a-1bc3-4925-bcff-f032ca5106fd None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.318066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 18/40] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:03.322422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494de8a-1bc3-4925-bcff-f032ca5106fd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:03.355741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:03.435767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494de8a-1bc3-4925-bcff-f032ca5106fd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:03.470455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b658b49-4433-4d89-8ad3-5e792f9070d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:03.471263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b658b49-4433-4d89-8ad3-5e792f9070d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.471557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b658b49-4433-4d89-8ad3-5e792f9070d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.471842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b658b49-4433-4d89-8ad3-5e792f9070d5 None admin] PATH_INFO: `/v3/domains/default/users/ab4196857ae341bbac204680cc59c0f9/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.473908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b658b49-4433-4d89-8ad3-5e792f9070d5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ab4196857ae341bbac204680cc59c0f9, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:03.475380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b658b49-4433-4d89-8ad3-5e792f9070d5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:03.572532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 19/41] 10.222.0.39 () {58 vars in 1361 bytes} [Mon Jul 18 08:24:03 2022] PUT /identity/v3/domains/default/users/ab4196857ae341bbac204680cc59c0f9/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:03.574326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e60238-585e-4d38-ae63-02048d458c0c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.574677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e60238-585e-4d38-ae63-02048d458c0c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.574969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e60238-585e-4d38-ae63-02048d458c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.601005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-95e60238-585e-4d38-ae63-02048d458c0c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:03.602382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-95e60238-585e-4d38-ae63-02048d458c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:03.653724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 23/42] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:24:03 2022] POST /identity/v3/projects => generated 301 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:03.653724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:03.686036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:03.708558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:03.743396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e60238-585e-4d38-ae63-02048d458c0c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:03.768618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:03.783742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844eae9-3f19-4596-a3c1-83c249779ddb None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:03.837325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:03.838821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.839117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.839407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.840596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:03.842402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:03.879415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e60238-585e-4d38-ae63-02048d458c0c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:03.918372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 24/44] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 08:24:03 2022] POST /identity/v3/roles => generated 223 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:03.920676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccc3e6-1137-411e-bca3-d48cd2b6ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:03.921759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc3e6-1137-411e-bca3-d48cd2b6ed0d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:03.921997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc3e6-1137-411e-bca3-d48cd2b6ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:03.922251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc3e6-1137-411e-bca3-d48cd2b6ed0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:03.923562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccc3e6-1137-411e-bca3-d48cd2b6ed0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:03.925104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccc3e6-1137-411e-bca3-d48cd2b6ed0d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:03.927265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 21/45] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:03.933446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:04.037604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:04.052560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930aa6e-3c0a-4af6-b990-2e79e5466f6a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:04.092590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b76ea-fdb7-4b45-bb3c-6c1d8bc6c915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:04.093348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b76ea-fdb7-4b45-bb3c-6c1d8bc6c915 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:04.093643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b76ea-fdb7-4b45-bb3c-6c1d8bc6c915 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:04.094045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b76ea-fdb7-4b45-bb3c-6c1d8bc6c915 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:04.094781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b76ea-fdb7-4b45-bb3c-6c1d8bc6c915 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:04.096264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b76ea-fdb7-4b45-bb3c-6c1d8bc6c915 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:04.172044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 25/46] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:24:03 2022] POST /identity/v3/projects => generated 312 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:05.669205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c98f5-fe02-486f-b9b6-246eba10e892 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:05.669749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c98f5-fe02-486f-b9b6-246eba10e892 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:05.669835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c98f5-fe02-486f-b9b6-246eba10e892 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:05.671226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 22/47] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:05.677550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82233f-aad5-4390-ae77-3c7b78768365 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:05.678036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82233f-aad5-4390-ae77-3c7b78768365 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:05.678122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82233f-aad5-4390-ae77-3c7b78768365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:05.696717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3c82233f-aad5-4390-ae77-3c7b78768365 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:05.698388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3c82233f-aad5-4390-ae77-3c7b78768365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:05.770379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 26/48] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:05.794003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c98f5-fe02-486f-b9b6-246eba10e892 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:05.882542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:05.905533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c98f5-fe02-486f-b9b6-246eba10e892 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:05.943228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:05.944037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:05.944326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:05.944626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:05.955217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:05.962900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:05.963862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:05.964643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 23/49] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:05.970564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82233f-aad5-4390-ae77-3c7b78768365 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:06.044832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:06.077235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82233f-aad5-4390-ae77-3c7b78768365 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:06.114523 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055e87-9e5c-49f7-83d4-176bbe2f55d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:06.115215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055e87-9e5c-49f7-83d4-176bbe2f55d4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.115511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055e87-9e5c-49f7-83d4-176bbe2f55d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.115901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055e87-9e5c-49f7-83d4-176bbe2f55d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.116617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a055e87-9e5c-49f7-83d4-176bbe2f55d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:06.117177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a055e87-9e5c-49f7-83d4-176bbe2f55d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:06.118640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a055e87-9e5c-49f7-83d4-176bbe2f55d4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:06.127725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 27/50] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:06.133213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:06.241506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bfcd1-c232-4007-b75d-7d16235b1417 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.242185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bfcd1-c232-4007-b75d-7d16235b1417 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.242568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bfcd1-c232-4007-b75d-7d16235b1417 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.243674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6670-ad03-48fa-b45d-f4eedac307fe None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:06.244065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 28/51] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:06.249354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f03fc7-61c5-4c86-90c3-25dbd6cba6fd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.249638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f03fc7-61c5-4c86-90c3-25dbd6cba6fd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.249948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f03fc7-61c5-4c86-90c3-25dbd6cba6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.267047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-56f03fc7-61c5-4c86-90c3-25dbd6cba6fd None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:06.268274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-56f03fc7-61c5-4c86-90c3-25dbd6cba6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:06.287757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:06.288645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.288940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.289224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] PATH_INFO: `/v3/users/ab4196857ae341bbac204680cc59c0f9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.290477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] RBAC: Authorizing `identity:get_user(user_id=ab4196857ae341bbac204680cc59c0f9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:06.292693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:06.294670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 24/52] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:06 2022] GET /identity/v3/users/ab4196857ae341bbac204680cc59c0f9 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:06.301190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:06.315114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:06.344742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 29/53] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:06.366248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f03fc7-61c5-4c86-90c3-25dbd6cba6fd None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:06.430487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbe095-d0e5-4b73-aa3b-cd367e51289e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:06.435521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:06.468230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:06.468747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.469039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.469323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.470614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:06.472093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:06.473813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 25/54] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:06.480096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:06.483367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f03fc7-61c5-4c86-90c3-25dbd6cba6fd None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:06.528762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:06.529838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.530160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.530541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.532122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:06.534077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:06.535930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 30/55] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:06.545081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:06.691526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8d56-88c3-44f1-87a3-222c71966a39 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:06.704284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:06.726756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:06.731465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507847f3-f3d0-48af-bba9-1295d76752a9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:06.736245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fcd4b-9dce-4f99-a236-3ac361dd3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:06.736951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fcd4b-9dce-4f99-a236-3ac361dd3965 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.737414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fcd4b-9dce-4f99-a236-3ac361dd3965 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.737913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fcd4b-9dce-4f99-a236-3ac361dd3965 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.739154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fcd4b-9dce-4f99-a236-3ac361dd3965 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:06.741821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fcd4b-9dce-4f99-a236-3ac361dd3965 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:06.780921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf8b87-2d56-48f8-afcb-82965a94f098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:06.781605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf8b87-2d56-48f8-afcb-82965a94f098 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:06.781920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf8b87-2d56-48f8-afcb-82965a94f098 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:06.782201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf8b87-2d56-48f8-afcb-82965a94f098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:06.783070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf8b87-2d56-48f8-afcb-82965a94f098 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.domain.id=default, user.id=ab4196857ae341bbac204680cc59c0f9) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:06.783389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf8b87-2d56-48f8-afcb-82965a94f098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:06.784968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf8b87-2d56-48f8-afcb-82965a94f098 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:06.794993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 26/56] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Jul 18 08:24:06 2022] GET /identity/v3/role_assignments?user.id=ab4196857ae341bbac204680cc59c0f9&scope.domain.id=default&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 530 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:06.839922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 31/57] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Jul 18 08:24:06 2022] POST /identity/v3/projects => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:24:08.942915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22398-9495-41da-b635-17900e9ee4db None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:08.943509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22398-9495-41da-b635-17900e9ee4db None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:08.943650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22398-9495-41da-b635-17900e9ee4db None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:08.945062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 27/58] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:08.951191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1088db0-d404-4460-9966-b9cf81428675 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:08.951693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1088db0-d404-4460-9966-b9cf81428675 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:08.951781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1088db0-d404-4460-9966-b9cf81428675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:08.970558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d1088db0-d404-4460-9966-b9cf81428675 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:08.971872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d1088db0-d404-4460-9966-b9cf81428675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:09.046364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 32/59] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:09.071702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22398-9495-41da-b635-17900e9ee4db None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:09.251576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22398-9495-41da-b635-17900e9ee4db None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:09.311431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c90797-a184-44b0-bdd0-c043c500701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:09.312821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90797-a184-44b0-bdd0-c043c500701a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:09.313349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90797-a184-44b0-bdd0-c043c500701a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:09.313889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90797-a184-44b0-bdd0-c043c500701a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:09.316001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c90797-a184-44b0-bdd0-c043c500701a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:09.318921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c90797-a184-44b0-bdd0-c043c500701a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:09.322066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 28/60] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:09.327844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1088db0-d404-4460-9966-b9cf81428675 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:09.435353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1088db0-d404-4460-9966-b9cf81428675 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:09.449082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:09.470204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974f550-88e7-4888-bd63-271404157c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:09.470880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974f550-88e7-4888-bd63-271404157c60 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:09.471172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974f550-88e7-4888-bd63-271404157c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:09.471451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974f550-88e7-4888-bd63-271404157c60 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:09.472172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974f550-88e7-4888-bd63-271404157c60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:09.474118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974f550-88e7-4888-bd63-271404157c60 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:09.591346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 33/61] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:24:09 2022] POST /identity/v3/users => generated 275 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:12.858589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b959-3cc0-45da-9386-bff07753f6c9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:12.859098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b959-3cc0-45da-9386-bff07753f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:12.859172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b959-3cc0-45da-9386-bff07753f6c9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:12.860696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 29/62] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:12.867696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe36f-acad-4084-9ec1-734a49bdc527 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:12.868696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe36f-acad-4084-9ec1-734a49bdc527 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:12.869180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe36f-acad-4084-9ec1-734a49bdc527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:12.878820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa82d7-390b-4a92-9ff1-6541bec1a39f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:12.879434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa82d7-390b-4a92-9ff1-6541bec1a39f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:12.879914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa82d7-390b-4a92-9ff1-6541bec1a39f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:12.881826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 30/63] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:12.904848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ab0ad-4497-4294-8e2c-9051d38bfef7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:12.905488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ab0ad-4497-4294-8e2c-9051d38bfef7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:12.906000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ab0ad-4497-4294-8e2c-9051d38bfef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:12.907460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-005fe36f-acad-4084-9ec1-734a49bdc527 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:12.908983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-005fe36f-acad-4084-9ec1-734a49bdc527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:12.934962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cb0ab0ad-4497-4294-8e2c-9051d38bfef7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:12.936451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cb0ab0ad-4497-4294-8e2c-9051d38bfef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:12.941122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:13.037632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 34/64] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:13.061509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe36f-acad-4084-9ec1-734a49bdc527 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:13.076262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 31/65] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:13.120303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ab0ad-4497-4294-8e2c-9051d38bfef7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:13.173003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:13.177611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe36f-acad-4084-9ec1-734a49bdc527 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:13.216437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:13.217253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:13.217546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:13.217856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:13.229970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:13.237874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:13.238777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:13.239964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 35/66] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:24:13.246278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:13.359253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecab63c-8cbe-4480-8a76-508c69691954 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:13.397215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:13.397852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:13.398153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:13.398445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:13.399222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:13.399539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:13.401761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:13.411503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 36/67] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:13.417727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:13.441874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:13.443326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ab0ad-4497-4294-8e2c-9051d38bfef7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:13.533670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9df66-be6d-4afd-96ed-4078701e3616 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:13.538451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:13.539285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:13.539574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:13.539850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:13.575810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:13.576992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:13.577432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:13.577903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] PATH_INFO: `/v3/users/ab4196857ae341bbac204680cc59c0f9` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:13.578794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:13.579872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] RBAC: Authorizing `identity:get_user(user_id=ab4196857ae341bbac204680cc59c0f9)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:13.581551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:13.583794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 37/68] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:13 2022] GET /identity/v3/users/ab4196857ae341bbac204680cc59c0f9 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:13.586362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:13.592199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:13.606180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:13.607116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:13.607862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 32/69] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:24:13.619059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:13.743078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:13.750964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4492dd-f4a0-4396-88cd-6ee4899aff97 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:13.795908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b428a-175d-4e82-bea9-dd08f786f831 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:13.798299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b3e93-d36a-4b85-9123-029c140469a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:13.799873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3e93-d36a-4b85-9123-029c140469a2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:13.800245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3e93-d36a-4b85-9123-029c140469a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:13.800603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3e93-d36a-4b85-9123-029c140469a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:13.834956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de73f4e-3849-4dcc-90ea-3ebb53630d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:13.836011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73f4e-3849-4dcc-90ea-3ebb53630d1a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:13.836519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73f4e-3849-4dcc-90ea-3ebb53630d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:13.837005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73f4e-3849-4dcc-90ea-3ebb53630d1a None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:13.838801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de73f4e-3849-4dcc-90ea-3ebb53630d1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:13.839409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de73f4e-3849-4dcc-90ea-3ebb53630d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:13.841203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de73f4e-3849-4dcc-90ea-3ebb53630d1a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:13.856313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 33/70] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:13.863015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98844ca9-47f0-40d8-ac47-db17c5ef4dff None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:13.864083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98844ca9-47f0-40d8-ac47-db17c5ef4dff None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:13.864688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98844ca9-47f0-40d8-ac47-db17c5ef4dff None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:13.870314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 34/71] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:13.871531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98844ca9-47f0-40d8-ac47-db17c5ef4dff None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:13.892550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b3e93-d36a-4b85-9123-029c140469a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:13.894173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b3e93-d36a-4b85-9123-029c140469a2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:13.948876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:14.014863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:14.019753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98844ca9-47f0-40d8-ac47-db17c5ef4dff None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:14.050233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 38/72] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:14.050233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4838ef-2933-4a69-a29f-492c6e2358cf None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.050233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4838ef-2933-4a69-a29f-492c6e2358cf None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.050233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4838ef-2933-4a69-a29f-492c6e2358cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.068328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:14.069625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.070350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.070836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.087378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8f4838ef-2933-4a69-a29f-492c6e2358cf None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:14.089965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:14.090116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8f4838ef-2933-4a69-a29f-492c6e2358cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:14.091898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:14.094149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 35/73] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:13 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:14.095337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:14.180788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 39/74] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:14.190908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4838ef-2933-4a69-a29f-492c6e2358cf None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:14.303581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f014d2-f898-42e7-af4c-231471d00c50 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:14.327482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:14.346111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:14.347272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.347662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.348033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.349578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:14.351211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:14.353031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 36/75] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:14 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:14.354643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:14.359173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4838ef-2933-4a69-a29f-492c6e2358cf None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:14.377180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:14.394961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:14.395620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.395901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.396178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.466394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b1667-1564-4cc4-96f4-a92298819d42 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:14.470497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:14.472010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:14.502577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5293b90-7595-4923-948f-cd6031cd55ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:14.503392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5293b90-7595-4923-948f-cd6031cd55ee None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.503669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5293b90-7595-4923-948f-cd6031cd55ee None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.503949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5293b90-7595-4923-948f-cd6031cd55ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.515240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5293b90-7595-4923-948f-cd6031cd55ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f5293b90-7595-4923-948f-cd6031cd55ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:14.523356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:14.530218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 37/76] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:24:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:14.531609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11284-d75d-4f0a-8ee2-a35da0a1a51c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.532371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11284-d75d-4f0a-8ee2-a35da0a1a51c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.532371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11284-d75d-4f0a-8ee2-a35da0a1a51c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.532371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 38/77] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:14.532371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cadf4-fb0e-4cd2-bf80-cd9458c2fdc0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.532602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cadf4-fb0e-4cd2-bf80-cd9458c2fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.533027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cadf4-fb0e-4cd2-bf80-cd9458c2fdc0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.535255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 39/78] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:14.536534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cadf4-fb0e-4cd2-bf80-cd9458c2fdc0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:14.600257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 40/79] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:14.601052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:14.608436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:14.622858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:14.671285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cadf4-fb0e-4cd2-bf80-cd9458c2fdc0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:14.723130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1419f-d4ab-4696-ad37-cfbb2314b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:14.724053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1419f-d4ab-4696-ad37-cfbb2314b938 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.724515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1419f-d4ab-4696-ad37-cfbb2314b938 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.724969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1419f-d4ab-4696-ad37-cfbb2314b938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.726536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1419f-d4ab-4696-ad37-cfbb2314b938 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=ab4196857ae341bbac204680cc59c0f9) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:14.727051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1419f-d4ab-4696-ad37-cfbb2314b938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:14.730132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1419f-d4ab-4696-ad37-cfbb2314b938 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:14.738640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 40/80] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:14 2022] GET /identity/v3/role_assignments?user.id=ab4196857ae341bbac204680cc59c0f9&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:14.740229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816d58-42d1-4d1c-8aac-8a7a8c10e9ac None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.740629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816d58-42d1-4d1c-8aac-8a7a8c10e9ac None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.741024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816d58-42d1-4d1c-8aac-8a7a8c10e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.760640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5514f-73b8-4a25-a4fd-d3454fc2d9d0 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:14.762107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-61816d58-42d1-4d1c-8aac-8a7a8c10e9ac None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:14.763943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-61816d58-42d1-4d1c-8aac-8a7a8c10e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:14.818212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda4fac-1454-401a-b388-c5001c6e7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:14.819243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4fac-1454-401a-b388-c5001c6e7f47 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.819686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4fac-1454-401a-b388-c5001c6e7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.820109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4fac-1454-401a-b388-c5001c6e7f47 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.821338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4fac-1454-401a-b388-c5001c6e7f47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:14.821872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4fac-1454-401a-b388-c5001c6e7f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:14.824243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda4fac-1454-401a-b388-c5001c6e7f47 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:14.835758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 41/81] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:24:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:14.840549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e5f3f-01bb-4b31-bfb3-4bfe70f0f7a1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:14.841053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e5f3f-01bb-4b31-bfb3-4bfe70f0f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:14.841549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e5f3f-01bb-4b31-bfb3-4bfe70f0f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:14.866224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-913e5f3f-01bb-4b31-bfb3-4bfe70f0f7a1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:14.868261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-913e5f3f-01bb-4b31-bfb3-4bfe70f0f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:14.901724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 41/82] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:14.901724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816d58-42d1-4d1c-8aac-8a7a8c10e9ac None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:14.982608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 42/83] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:14.983776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e5f3f-01bb-4b31-bfb3-4bfe70f0f7a1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:14.993949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:15.004365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:15.114445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816d58-42d1-4d1c-8aac-8a7a8c10e9ac None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:15.125778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e5f3f-01bb-4b31-bfb3-4bfe70f0f7a1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:15.171619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:15.173078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:15.173464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:15.173988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:15.176089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:15.178307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:15.178716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:15.179731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:15.180188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:15.180652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:15.182079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 43/84] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:14 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:15.183071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:15.187031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:15.190256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:15.193790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 42/85] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:14 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:15.195356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:15.298103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:15.341821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916398a-a72f-41e7-8150-d1b04f699958 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:15.372590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831c85-61a9-4eb9-aa63-f624a93f95c7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:15.387867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:15.400704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:15.402939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:15.402939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:15.402939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:15.415944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:15.424509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:15.426573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 44/86] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:15.428681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:15.441290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:15.442731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:15.443904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:15.443904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:15.446205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:15.449642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:15.460477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 43/87] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:15.460477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:15.600829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817a0a-0d09-4a03-8dbb-3b709ef88487 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:15.647552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:15.648481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:15.648857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:15.649286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:15.659574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8027-7d36-4530-b762-1d221fe3d7a7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:15.661588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:15.717974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:15.719033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:15.719491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:15.719942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:15.720977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=194a4d4cc5174f9abf0af4c2de12d9c4) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:15.721700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:15.723297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:15.741719 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 44/88] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:15 2022] GET /identity/v3/role_assignments?user.id=194a4d4cc5174f9abf0af4c2de12d9c4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:15.741719 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:15.789243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:15.792722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:15.825466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:15.956064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e434398-0869-4699-8e95-8c8d97f7df4a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:16.009471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 45/89] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:16.011889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:16.038078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:16.039781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:16.040254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:16.041053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:16.043075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:16.046557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:16.046557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:16.067870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 45/90] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:16.069335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:16.086792 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:16.172528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eef92-6058-413f-af8f-672d6796b43c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:16.231064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85e8aa-8608-4c0f-9c8f-a2fd74cc63a1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:16.232774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:16.233632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:16.233989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:16.234360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:16.235559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:16.236720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:16.238494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:16.275697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:16.276613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:16.277117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:16.277405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:16.279032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:16.280594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:16.282796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 46/91] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:16 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:16.283470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:16.341744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 46/92] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:24:16 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:16.343693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:16.455577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebfc3a-7104-4915-89ce-0e3d5dea0f17 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:16.487180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:16.498197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b086-2b00-4916-89f2-adafa156baf3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:16.549722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:16.549722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:16.549722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:16.549722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:16.558332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:16.558332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:16.558547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] RBAC: Adding query filter params (role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=194a4d4cc5174f9abf0af4c2de12d9c4) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:16.558628 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:16.558692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:16.558770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:16.558837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:16.558906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:16.560367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:16.560820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 47/93] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:16 2022] GET /identity/v3/role_assignments?user.id=194a4d4cc5174f9abf0af4c2de12d9c4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=fb047c0afbd247f98f75175d913fed8e => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:16.562342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 47/94] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:16 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:16.568753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:16.726928 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fc334-f106-4026-9aae-cabbd8b1ec19 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:16.768225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:16.768823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:16.769112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:16.769393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:16.804597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:16.858710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:16.860259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:17.025072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 48/95] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:17.034921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:17.124769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:17.206265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb771c-93f7-4755-85cf-27906e9ece2b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:17.250521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2747898-b31d-412a-bcfc-c4c60227a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:17.251411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2747898-b31d-412a-bcfc-c4c60227a428 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:17.251700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2747898-b31d-412a-bcfc-c4c60227a428 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:17.251985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2747898-b31d-412a-bcfc-c4c60227a428 None admin] PATH_INFO: `/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:17.253312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2747898-b31d-412a-bcfc-c4c60227a428 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd6181a80f44e8e8ee19d99255bb6e3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:17.254836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2747898-b31d-412a-bcfc-c4c60227a428 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:17.256621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 48/96] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:17 2022] GET /identity/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:17.263731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:17.317429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af4536-91f8-4226-adf8-4c307fa4f4d3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:17.317904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af4536-91f8-4226-adf8-4c307fa4f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:17.318298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af4536-91f8-4226-adf8-4c307fa4f4d3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:17.319859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 49/97] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:17.326850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee3e1-3d29-424d-9035-59732be28a4a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:17.327307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee3e1-3d29-424d-9035-59732be28a4a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:17.327716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee3e1-3d29-424d-9035-59732be28a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:17.355020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-dc4ee3e1-3d29-424d-9035-59732be28a4a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:17.357511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dc4ee3e1-3d29-424d-9035-59732be28a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:17.400440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:17.549708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c150c-79a0-4a3f-8b73-617066fce8b4 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:17.580365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 50/98] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:17.612421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:17.613773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:17.614544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:17.615166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:17.617127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=3bd6181a80f44e8e8ee19d99255bb6e3, user.id=194a4d4cc5174f9abf0af4c2de12d9c4) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:17.617832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:17.618896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee3e1-3d29-424d-9035-59732be28a4a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:17.620950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:17.637717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 49/99] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:17 2022] GET /identity/v3/role_assignments?user.id=194a4d4cc5174f9abf0af4c2de12d9c4&scope.project.id=3bd6181a80f44e8e8ee19d99255bb6e3&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 259 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:17.701627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:17.794716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee3e1-3d29-424d-9035-59732be28a4a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:17.856545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:17.857261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:17.857547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:17.857853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:17.873604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:17.881470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:17.882816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:17.883946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 51/100] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:24:17.890014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:18.110652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cfa22-b719-46cd-bdd0-ed340c73bcfe None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:18.146489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:18.165893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:18.167576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:18.168003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:18.168729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:18.169192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:18.169651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:18.171969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:18.188663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 50/101] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:18.194480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:18.416840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:18.422528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b740d3-004c-4d08-9f4c-7d65df03ce00 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:18.473148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:18.474293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:18.474788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:18.475260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] PATH_INFO: `/v3/users/ab4196857ae341bbac204680cc59c0f9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:18.483148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] RBAC: Authorizing `identity:get_user(user_id=ab4196857ae341bbac204680cc59c0f9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:18.485696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:18.488710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 52/102] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:18 2022] GET /identity/v3/users/ab4196857ae341bbac204680cc59c0f9 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:18.496231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:18.648730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175fe0d-1f0a-40f4-90fc-26025f0a98b2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:18.699002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475b1ce-e900-4a10-8109-d502850da080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:18.699795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b1ce-e900-4a10-8109-d502850da080 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:18.700083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b1ce-e900-4a10-8109-d502850da080 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:18.700363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b1ce-e900-4a10-8109-d502850da080 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:18.709953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475b1ce-e900-4a10-8109-d502850da080 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:18.711496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475b1ce-e900-4a10-8109-d502850da080 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:18.714052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 51/103] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:18 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:18.721478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:18.879492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d5b3-1b55-4055-937c-84737e8a08a7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:18.937563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66b32c-9743-4797-8b92-b27143e8c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:18.938936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66b32c-9743-4797-8b92-b27143e8c575 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:18.939228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66b32c-9743-4797-8b92-b27143e8c575 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:18.939646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66b32c-9743-4797-8b92-b27143e8c575 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91/users/ab4196857ae341bbac204680cc59c0f9/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:18.942413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66b32c-9743-4797-8b92-b27143e8c575 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a67e36889844dca6d15883832f5e91, user_id=ab4196857ae341bbac204680cc59c0f9, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:18.944239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66b32c-9743-4797-8b92-b27143e8c575 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:19.038386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 53/104] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:18 2022] PUT /identity/v3/projects/d7a67e36889844dca6d15883832f5e91/users/ab4196857ae341bbac204680cc59c0f9/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:19.469605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fefa8-d7bd-4aa5-9800-8bca5ad6ad70 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:19.470179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fefa8-d7bd-4aa5-9800-8bca5ad6ad70 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:19.470700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fefa8-d7bd-4aa5-9800-8bca5ad6ad70 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:19.473894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 52/105] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:19.484282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4d9a0-6ed4-4c83-9ab4-c8bf2bb3f7cf None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:19.485882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4d9a0-6ed4-4c83-9ab4-c8bf2bb3f7cf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:19.486674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4d9a0-6ed4-4c83-9ab4-c8bf2bb3f7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:19.525989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2cb4d9a0-6ed4-4c83-9ab4-c8bf2bb3f7cf None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:19.528161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2cb4d9a0-6ed4-4c83-9ab4-c8bf2bb3f7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:19.590750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:19.707989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 54/106] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:19.775010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fefa8-d7bd-4aa5-9800-8bca5ad6ad70 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:19.886518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:19.987456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fefa8-d7bd-4aa5-9800-8bca5ad6ad70 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:20.055672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:20.057661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.058210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.058794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.071676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d4e31-fef2-41a5-bc37-0001bba7bcf3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.072779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d4e31-fef2-41a5-bc37-0001bba7bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.073377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d4e31-fef2-41a5-bc37-0001bba7bcf3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.076256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 55/107] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:20.083579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8d25-f367-4ddf-a6b0-6ebe118b46c8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.084141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8d25-f367-4ddf-a6b0-6ebe118b46c8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.084660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e8d25-f367-4ddf-a6b0-6ebe118b46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.102362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:20.121530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:20.122496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:20.123252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:20.126126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 53/108] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:20.135527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-314e8d25-f367-4ddf-a6b0-6ebe118b46c8 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:20.137591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-314e8d25-f367-4ddf-a6b0-6ebe118b46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:20.146984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:20.301541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 56/109] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:20.372789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8d25-f367-4ddf-a6b0-6ebe118b46c8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:20.377062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1af983-726c-4ae3-af79-ddc46f7ca976 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:20.405901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:20.491152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:20.492104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.492613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.493081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.495131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:20.495677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:20.497314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:20.526072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:20.531913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 54/110] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:20.546186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:20.560043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e8d25-f367-4ddf-a6b0-6ebe118b46c8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:20.627989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c22996-5f32-4419-80f3-385d9ed23d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:20.628745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22996-5f32-4419-80f3-385d9ed23d8f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.629036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22996-5f32-4419-80f3-385d9ed23d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.629320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22996-5f32-4419-80f3-385d9ed23d8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.649783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c22996-5f32-4419-80f3-385d9ed23d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e4c22996-5f32-4419-80f3-385d9ed23d8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:20.666397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:20.667449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:20.668216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:20.668799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 57/111] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:24:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:20.670172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15d81-b44d-4de7-a830-ba1a5855cc7a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.670172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15d81-b44d-4de7-a830-ba1a5855cc7a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.670344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15d81-b44d-4de7-a830-ba1a5855cc7a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.671907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 58/112] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:20.677664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15d81-b44d-4de7-a830-ba1a5855cc7a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:20.803760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6161e44-ff54-4342-8c29-12059d7d06f7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:20.904757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15d81-b44d-4de7-a830-ba1a5855cc7a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:20.919686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5131-5022-4a82-95a5-801a0c68bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:20.920620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5131-5022-4a82-95a5-801a0c68bf0f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.920952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5131-5022-4a82-95a5-801a0c68bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.921191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5131-5022-4a82-95a5-801a0c68bf0f None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.922824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5131-5022-4a82-95a5-801a0c68bf0f None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:20.924502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5131-5022-4a82-95a5-801a0c68bf0f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:20.933709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 55/113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:20 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:20.935504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae0dc-f900-42cb-aa0e-7204216efcc0 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.935976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae0dc-f900-42cb-aa0e-7204216efcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.936404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae0dc-f900-42cb-aa0e-7204216efcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.966846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4d8ae0dc-f900-42cb-aa0e-7204216efcc0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:20.968121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4d8ae0dc-f900-42cb-aa0e-7204216efcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:20.990197 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:20.991552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:20.992016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:20.992509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:20.994017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:20.994606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:20.997296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:21.015476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 59/114] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:24:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:21.017063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:21.032810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:21.070567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:21.159585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c902d-7e2b-4006-9dee-bec05dbb59e6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:21.162459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 56/115] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:21.167000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1f18c-aa1d-47f1-bdf0-89fe8bf91271 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.167527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1f18c-aa1d-47f1-bdf0-89fe8bf91271 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.168045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1f18c-aa1d-47f1-bdf0-89fe8bf91271 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.171639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 57/116] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:21.173375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1f18c-aa1d-47f1-bdf0-89fe8bf91271 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:21.224779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33dd0a-6a3d-4eb5-96e8-5b0c4b779640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:21.226118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33dd0a-6a3d-4eb5-96e8-5b0c4b779640 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.226631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33dd0a-6a3d-4eb5-96e8-5b0c4b779640 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.227130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33dd0a-6a3d-4eb5-96e8-5b0c4b779640 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.229320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33dd0a-6a3d-4eb5-96e8-5b0c4b779640 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:21.231355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33dd0a-6a3d-4eb5-96e8-5b0c4b779640 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:21.233701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 60/117] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:21 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:21.235312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea237-a373-4644-9cab-bd8807bd50d6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.235814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea237-a373-4644-9cab-bd8807bd50d6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.236313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea237-a373-4644-9cab-bd8807bd50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.285056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9eeea237-a373-4644-9cab-bd8807bd50d6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:21.287477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9eeea237-a373-4644-9cab-bd8807bd50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:21.393032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1f18c-aa1d-47f1-bdf0-89fe8bf91271 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:21.401563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 61/118] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:21.403329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea237-a373-4644-9cab-bd8807bd50d6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:21.434354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:21.456112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:21.456998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.457281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.457561 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.458841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:21.460370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:21.467558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 58/119] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:21 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:21.467558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:21.530163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:21.571300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea237-a373-4644-9cab-bd8807bd50d6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:21.620653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff4b7-e6fe-44f8-9f0c-3e605064999b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:21.621994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ab58-8acb-4086-abd9-604fcfa58e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:21.623095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ab58-8acb-4086-abd9-604fcfa58e3a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.623574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ab58-8acb-4086-abd9-604fcfa58e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.624027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ab58-8acb-4086-abd9-604fcfa58e3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283ab58-8acb-4086-abd9-604fcfa58e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:21.627684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283ab58-8acb-4086-abd9-604fcfa58e3a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:21.629704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 62/120] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:21.632152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c05fb-8212-4d97-9790-a27223e79d73 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.632662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c05fb-8212-4d97-9790-a27223e79d73 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.633159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c05fb-8212-4d97-9790-a27223e79d73 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.636605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 63/121] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:21.638171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c05fb-8212-4d97-9790-a27223e79d73 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:21.678685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:21.680139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.680605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.681122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91/users/194a4d4cc5174f9abf0af4c2de12d9c4/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.685100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a67e36889844dca6d15883832f5e91, user_id=194a4d4cc5174f9abf0af4c2de12d9c4, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:21.689062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:21.741032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:21.772001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c05fb-8212-4d97-9790-a27223e79d73 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:21.777384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 59/122] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:21 2022] PUT /identity/v3/projects/d7a67e36889844dca6d15883832f5e91/users/194a4d4cc5174f9abf0af4c2de12d9c4/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:21.787045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:21.832544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:21.834276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.835189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.835976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:21.858498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:21.873935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:21.875509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:21.876926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:21.881319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 64/123] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:21.883285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:21.940375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:21.944151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104940-a9b4-417e-a9e8-b93877bce188 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:21.997520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb3830-acd2-4276-a55e-bdc7150b485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:21.998589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb3830-acd2-4276-a55e-bdc7150b485e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:21.998880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb3830-acd2-4276-a55e-bdc7150b485e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:21.999167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb3830-acd2-4276-a55e-bdc7150b485e None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.000926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb3830-acd2-4276-a55e-bdc7150b485e None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:22.002594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb3830-acd2-4276-a55e-bdc7150b485e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:22.009709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 60/124] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:21 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:22.009709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc4f30-e471-4e07-8a4e-3bffd699912a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.009709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc4f30-e471-4e07-8a4e-3bffd699912a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.009709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc4f30-e471-4e07-8a4e-3bffd699912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.031357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-34fc4f30-e471-4e07-8a4e-3bffd699912a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:22.032586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-34fc4f30-e471-4e07-8a4e-3bffd699912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:22.111381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b747ad-3070-4dec-b552-104ca8c02926 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:22.169720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 61/125] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:22.169720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc4f30-e471-4e07-8a4e-3bffd699912a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:22.175260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:22.175948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.176232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.176508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.177247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:22.178790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:22.191179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:22.279122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 65/126] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:24:21 2022] POST /identity/v3/projects => generated 302 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:22.280516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:22.331440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:22.340465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc4f30-e471-4e07-8a4e-3bffd699912a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:22.420706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a651e-535a-4858-a913-4d57f7ef2cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:22.422481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a651e-535a-4858-a913-4d57f7ef2cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.423432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a651e-535a-4858-a913-4d57f7ef2cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.424365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a651e-535a-4858-a913-4d57f7ef2cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.426376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a651e-535a-4858-a913-4d57f7ef2cd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:22.427580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a651e-535a-4858-a913-4d57f7ef2cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:22.430779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a651e-535a-4858-a913-4d57f7ef2cd2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:22.431013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f515b-9bf8-4b8a-902e-8f96f9f9379c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:22.450862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 62/127] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:22.454066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3afc-8168-457e-a998-3958eb070080 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.455150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3afc-8168-457e-a998-3958eb070080 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.456092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3afc-8168-457e-a998-3958eb070080 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.459436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 63/128] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:22.461011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d3afc-8168-457e-a998-3958eb070080 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:22.483598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:22.484585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.485086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.485086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91/users/194a4d4cc5174f9abf0af4c2de12d9c4/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.489117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a67e36889844dca6d15883832f5e91, user_id=194a4d4cc5174f9abf0af4c2de12d9c4, role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:22.492297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:22.593032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 66/129] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:22 2022] PUT /identity/v3/projects/d7a67e36889844dca6d15883832f5e91/users/194a4d4cc5174f9abf0af4c2de12d9c4/roles/fb047c0afbd247f98f75175d913fed8e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:22.596334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:22.608190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d3afc-8168-457e-a998-3958eb070080 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:22.655646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de689ed-bf82-4fc0-8f24-61e996b55644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:22.656515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de689ed-bf82-4fc0-8f24-61e996b55644 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.656808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de689ed-bf82-4fc0-8f24-61e996b55644 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.657136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de689ed-bf82-4fc0-8f24-61e996b55644 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.672476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de689ed-bf82-4fc0-8f24-61e996b55644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-5de689ed-bf82-4fc0-8f24-61e996b55644 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:22.680783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:22.682499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 64/130] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:22.683954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f237b-e51f-47e2-9772-b74704e703e8 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.685334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f237b-e51f-47e2-9772-b74704e703e8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.685334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f237b-e51f-47e2-9772-b74704e703e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.729002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-859f237b-e51f-47e2-9772-b74704e703e8 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:22.731721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-859f237b-e51f-47e2-9772-b74704e703e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:22.748481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:22.766718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:22.863026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 65/131] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:22.863927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f237b-e51f-47e2-9772-b74704e703e8 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:22.870487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f162459-106a-4711-9a13-c9510f819bc6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:22.921917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:22.922843 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:22.923129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:22.923409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] PATH_INFO: `/v3/users/9adf7afebb57471bbd6621bc85909958` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:22.943989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] RBAC: Authorizing `identity:get_user(user_id=9adf7afebb57471bbd6621bc85909958)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:22.945516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:22.948422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 67/132] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:22 2022] GET /identity/v3/users/9adf7afebb57471bbd6621bc85909958 => generated 289 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:22.949347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.028707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f237b-e51f-47e2-9772-b74704e703e8 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:23.074553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61984c1-2cb6-41a7-9446-e4f851eda209 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:23.077213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:23.116371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:23.117203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:23.117493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:23.117807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:23.131495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:23.139493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:23.142705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 68/133] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:23.145986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.153299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:23.153299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:23.153299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:23.153299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:23.154251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:23.154251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:23.154251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:23.180068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 66/134] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:23.180643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.227162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:23.265802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde81c-fa38-46c5-96e0-8caf48b86d76 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:23.311344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:23.312019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:23.312425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:23.312657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:23.397997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9918-0f21-4a3a-9488-c9e608b87371 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:23.401704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:23.439547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:23.441122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:23.441607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:23.442093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:23.443031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:23.443554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:23.445610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:23.457707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 67/135] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:23.458891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.537014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:23.539485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:23.596063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:23.653239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cca4d-64fd-4e9c-9d6e-0fdf5f08540e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:23.739208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:23.740114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:23.740405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:23.740687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:23.741706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 69/136] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:23.742503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.746637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:23.748173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:23.750017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 68/137] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:23 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:23.750826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.815379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:23.864934 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a677de-1841-4025-a278-eb5a3eee57cf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:23.907609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:23.908598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:23.908885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:23.909180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] PATH_INFO: `/v3/users/ab4196857ae341bbac204680cc59c0f9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:23.910524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] RBAC: Authorizing `identity:get_user(user_id=ab4196857ae341bbac204680cc59c0f9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:23.910785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b2bd3-e884-4e07-9e54-0650ec36fd59 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:23.912068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:23.914333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 70/138] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:23 2022] GET /identity/v3/users/ab4196857ae341bbac204680cc59c0f9 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:23.915161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.955217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:23.956102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:23.956395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:23.956681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:23.958096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:23.959599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:23.961408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 69/139] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:23 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:23.963784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:23.979108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:24.080151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325554f3-1e77-45f3-aa3a-24129c614fd8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:24.098825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b88f-efe9-4f71-a66e-128cab30b1fa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:24.122208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:24.123036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.123436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.123845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.167277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:24.183866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:24.184813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.185104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.185382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] PATH_INFO: `/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.195964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd6181a80f44e8e8ee19d99255bb6e3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:24.195964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:24.195964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 71/140] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:23 2022] GET /identity/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3 => generated 312 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:24.195964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:24.207153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:24.208811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:24.222459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:24.320713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57a355-9690-466e-9c77-81debf8beff0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:24.328280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 70/141] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:24.333730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:24.360328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e85bfa-047c-47e4-8b30-f7732f4df7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:24.360999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e85bfa-047c-47e4-8b30-f7732f4df7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.361290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e85bfa-047c-47e4-8b30-f7732f4df7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.361571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e85bfa-047c-47e4-8b30-f7732f4df7f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.362594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e85bfa-047c-47e4-8b30-f7732f4df7f1 None admin] RBAC: Adding query filter params (role.id=8298062094fc4491a06a7a486ebc3b42, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=9adf7afebb57471bbd6621bc85909958) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:24.362966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e85bfa-047c-47e4-8b30-f7732f4df7f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:24.364641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e85bfa-047c-47e4-8b30-f7732f4df7f1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:24.372662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 72/142] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:24 2022] GET /identity/v3/role_assignments?user.id=9adf7afebb57471bbd6621bc85909958&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=8298062094fc4491a06a7a486ebc3b42 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:24.380429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d242e-3e4c-4600-8be9-92c6741ac2ff None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.380836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d242e-3e4c-4600-8be9-92c6741ac2ff None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.381116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d242e-3e4c-4600-8be9-92c6741ac2ff None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.383000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 73/143] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:24.383809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d242e-3e4c-4600-8be9-92c6741ac2ff None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:24.459155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402dd62-0e8f-4bef-a4a5-03bec61b5aac None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:24.472584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:24.503326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c785631-d466-4c80-af5a-6e19303723f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:24.504246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785631-d466-4c80-af5a-6e19303723f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.504533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785631-d466-4c80-af5a-6e19303723f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.504815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785631-d466-4c80-af5a-6e19303723f3 None admin] PATH_INFO: `/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3/users/194a4d4cc5174f9abf0af4c2de12d9c4/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.507072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c785631-d466-4c80-af5a-6e19303723f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd6181a80f44e8e8ee19d99255bb6e3, user_id=194a4d4cc5174f9abf0af4c2de12d9c4, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:24.508649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c785631-d466-4c80-af5a-6e19303723f3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:24.522194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:24.581887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d242e-3e4c-4600-8be9-92c6741ac2ff None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:24.609368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 71/144] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:24 2022] PUT /identity/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3/users/194a4d4cc5174f9abf0af4c2de12d9c4/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:24.610895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84080d14-c8cd-48b1-9d67-eadc243337e9 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.611509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84080d14-c8cd-48b1-9d67-eadc243337e9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.611958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84080d14-c8cd-48b1-9d67-eadc243337e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.628815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:24.629978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.630406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.630899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.632390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:24.634326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:24.637044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 74/145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:24 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:24.645296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:24.648271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-84080d14-c8cd-48b1-9d67-eadc243337e9 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:24.650132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-84080d14-c8cd-48b1-9d67-eadc243337e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:24.740631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 72/146] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:24.769721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84080d14-c8cd-48b1-9d67-eadc243337e9 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:24.839107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16449-a6c9-4099-9e01-171729aa4c85 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:24.935092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:24.950470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:24.951590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:24.952088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:24.952599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:24.954419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=ab4196857ae341bbac204680cc59c0f9) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:24.955020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:24.959145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:24.982116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 75/147] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:24 2022] GET /identity/v3/role_assignments?user.id=ab4196857ae341bbac204680cc59c0f9&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:25.002433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:25.006009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84080d14-c8cd-48b1-9d67-eadc243337e9 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:25.050397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:25.051213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:25.051492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:25.051772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:25.065625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:25.074923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:25.077042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:25.080038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 73/148] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:24:25.087076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:25.236572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34c5f-d51d-4225-b9f3-7a2e16d565a1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:25.278477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:25.279175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:25.279455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:25.279731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:25.280572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:25.280880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:25.282397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:25.292847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 76/149] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:25.298876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:25.420129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308c529-1b5c-46c7-9f68-c9bb10e4f3e4 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:25.459305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75706e-08ed-4110-9f41-6f76ff79e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:25.460198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75706e-08ed-4110-9f41-6f76ff79e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:25.460489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75706e-08ed-4110-9f41-6f76ff79e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:25.460750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75706e-08ed-4110-9f41-6f76ff79e4d7 None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:25.462074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75706e-08ed-4110-9f41-6f76ff79e4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:25.464744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75706e-08ed-4110-9f41-6f76ff79e4d7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:25.466495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 74/150] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:25 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:25.474971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:25.555921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:25.606328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de74b-351f-4f95-b1c5-7a35e623ba08 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:25.647132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:25.648054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:25.648480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:25.648896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:25.730430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:25.732187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:25.799733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:25.833056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b2e7-5f68-4596-84b9-72cd50b6c6e8 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:25.833934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b2e7-5f68-4596-84b9-72cd50b6c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:25.834395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b2e7-5f68-4596-84b9-72cd50b6c6e8 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:25.836125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 75/151] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:25.845271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ae432-1941-46a5-91cf-52b3ab957c7a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:25.845614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ae432-1941-46a5-91cf-52b3ab957c7a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:25.845844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ae432-1941-46a5-91cf-52b3ab957c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:25.873249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 77/152] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:24:25.877706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-eb7ae432-1941-46a5-91cf-52b3ab957c7a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:25.877706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eb7ae432-1941-46a5-91cf-52b3ab957c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:25.881054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:25.914235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:25.966391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 76/153] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:25.992077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ae432-1941-46a5-91cf-52b3ab957c7a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:26.106195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ae432-1941-46a5-91cf-52b3ab957c7a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:26.146773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:26.147721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:26.148006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:26.148281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:26.149640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:26.152010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:26.154165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 77/154] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:26.159723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:26.179689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ee5f-9bfe-4eb3-909c-72c7aa2e5d61 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:26.198286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:26.254844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:26.255734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:26.256007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:26.256280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:26.262670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:26.264248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:26.269730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 78/155] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:25 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:26.278688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:26.317775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:26.389651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691ad65-0604-4248-8426-c4b8be7b5f9b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:26.494913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:26.496087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:26.496594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:26.497088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:26.498464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:26.501160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:26.530254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe52249-10e4-4652-a658-fe789c66c314 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:26.605119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a7372-b8a0-46a2-bb7f-613375a0fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:26.606299 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7372-b8a0-46a2-bb7f-613375a0fd03 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:26.606800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7372-b8a0-46a2-bb7f-613375a0fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:26.607266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7372-b8a0-46a2-bb7f-613375a0fd03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:26.608878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a7372-b8a0-46a2-bb7f-613375a0fd03 None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=194a4d4cc5174f9abf0af4c2de12d9c4) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:26.609434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a7372-b8a0-46a2-bb7f-613375a0fd03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:26.612247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a7372-b8a0-46a2-bb7f-613375a0fd03 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:26.624425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 79/156] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:26 2022] GET /identity/v3/role_assignments?user.id=194a4d4cc5174f9abf0af4c2de12d9c4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:26.635786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d213e-6f8e-4419-ada0-a7f597548a4e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:26.636748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d213e-6f8e-4419-ada0-a7f597548a4e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:26.637501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d213e-6f8e-4419-ada0-a7f597548a4e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:26.640778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 80/157] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:26.651527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613609-04e2-420f-9ccb-4cfcdc4a4e17 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:26.652406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613609-04e2-420f-9ccb-4cfcdc4a4e17 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:26.653157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613609-04e2-420f-9ccb-4cfcdc4a4e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:26.660344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 78/158] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:24:26 2022] POST /identity/v3/users => generated 283 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:24:26.683820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a5613609-04e2-420f-9ccb-4cfcdc4a4e17 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:26.685130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a5613609-04e2-420f-9ccb-4cfcdc4a4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:26.822811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:26.864403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:27.035873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:27.064666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0e15-c50e-4a7f-9b4b-3d3eae0ce05b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:27.142161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:27.143593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:27.144103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:27.144611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:27.168350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:27.185505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:27.186802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:27.188765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 79/160] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:27.198042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5613609-04e2-420f-9ccb-4cfcdc4a4e17 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:27.233835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:27.351804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5613609-04e2-420f-9ccb-4cfcdc4a4e17 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:27.410111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:27.411299 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:27.411739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:27.412195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:27.413508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:27.413852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:27.417005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:27.432958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 82/161] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:24:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:27.442023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:27.603483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77569c-0952-4ab3-ab18-b9e11ea401cd None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:27.673976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228704c2-81d6-4065-9640-898a4753c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:27.675394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228704c2-81d6-4065-9640-898a4753c14f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:27.675903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228704c2-81d6-4065-9640-898a4753c14f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:27.676418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228704c2-81d6-4065-9640-898a4753c14f None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:27.677893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228704c2-81d6-4065-9640-898a4753c14f None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:27.680824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228704c2-81d6-4065-9640-898a4753c14f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:27.684437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 80/162] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:27 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:27.692368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:27.823839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:27.853202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506c883-ea40-4909-9a7e-401fea052bac None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:27.914731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:27.915429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:27.915956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:27.916463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:27.938175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecfea1-fd81-47f9-a287-ff4d5e791139 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:27.938683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecfea1-fd81-47f9-a287-ff4d5e791139 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:27.939000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecfea1-fd81-47f9-a287-ff4d5e791139 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:27.942003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 81/163] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:27.953863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67dc8-9016-473d-b8e2-897e9b9660ed None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:27.954818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67dc8-9016-473d-b8e2-897e9b9660ed None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:27.955624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67dc8-9016-473d-b8e2-897e9b9660ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:28.000636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-66f67dc8-9016-473d-b8e2-897e9b9660ed None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:28.001908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-66f67dc8-9016-473d-b8e2-897e9b9660ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:28.016934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:28.070991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:28.073609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:28.152529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 82/164] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:28.153921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d5948-938d-4c1c-b7ea-2f3facdcbfee None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:28.154212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d5948-938d-4c1c-b7ea-2f3facdcbfee None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:28.154487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d5948-938d-4c1c-b7ea-2f3facdcbfee None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:28.155955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 83/165] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:28.163823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004229a-a2e7-439f-b6cd-ceee3382565e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:28.164125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004229a-a2e7-439f-b6cd-ceee3382565e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:28.166190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004229a-a2e7-439f-b6cd-ceee3382565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:28.205061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2004229a-a2e7-439f-b6cd-ceee3382565e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:28.206392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2004229a-a2e7-439f-b6cd-ceee3382565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:28.249819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:28.282291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 83/166] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:28.283234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:28.336000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 84/167] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:28.336973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004229a-a2e7-439f-b6cd-ceee3382565e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:28.428082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:28.463273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004229a-a2e7-439f-b6cd-ceee3382565e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:28.509530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:28.510848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:28.511283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:28.511778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:28.514137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:28.515795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:28.518591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 85/168] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:28 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:28.521240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:28.563292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a16d5-9d4a-4fda-83ab-68b00d713fa7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:28.631795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:28.633576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:28.634848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:28.635373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:28.649469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:28.660277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:28.661425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:28.662262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:28.668894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 84/169] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:28.671845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:28.738184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b331ca3-980c-4d2c-8eaf-51999d5cc1e8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:28.767436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:28.815935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:28.817148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:28.817656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:28.818163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:28.834804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:28.844313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:28.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:28.858698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:28.859485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:28.862468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 86/170] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:28.863599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:28.931785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8de4c-cd1f-4a74-8d2f-4fc36f9fef21 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:28.975323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd3a4a-ca2e-4ec9-a60c-605ea47ce995 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:29.015150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:29.016234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:29.017003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:29.018388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:29.019543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:29.021150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:29.023613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:29.037294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:29.038413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:29.038927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:29.039409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:29.041037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] RBAC: Adding query filter params (role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=194a4d4cc5174f9abf0af4c2de12d9c4) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:29.041615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:29.043440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:29.046233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 87/171] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:29.049562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:29.066138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 85/172] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:28 2022] GET /identity/v3/role_assignments?user.id=194a4d4cc5174f9abf0af4c2de12d9c4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=fb047c0afbd247f98f75175d913fed8e => generated 608 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:29.067406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:29.166385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:29.217922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fbab0-6250-4a7c-8572-924cc1ef9e1b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:29.259235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:29.260471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:29.260925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:29.261436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:29.262543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:29.263057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:29.264689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:29.275521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 88/173] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:29.283686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:29.353233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d24e-5a27-4356-aacb-8258d5257a8b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:29.366075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:29.410493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7049c17-094e-4a83-9db2-2ccf0260809a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:29.417176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:29.418151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:29.418444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:29.418724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] PATH_INFO: `/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:29.421365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=194a4d4cc5174f9abf0af4c2de12d9c4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:29.423086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:29.425359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 86/174] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:29 2022] GET /identity/v3/users/194a4d4cc5174f9abf0af4c2de12d9c4 => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:29.431821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:29.441981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:29.456895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:29.458185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:29.468894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:29.468894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] PATH_INFO: `/v3/users/9adf7afebb57471bbd6621bc85909958` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:29.468894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] RBAC: Authorizing `identity:get_user(user_id=9adf7afebb57471bbd6621bc85909958)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:29.468894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:29.468894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 89/175] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:29 2022] GET /identity/v3/users/9adf7afebb57471bbd6621bc85909958 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:29.473719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:29.636353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99446de7-20f5-41a8-a8e7-d612ecfcb4f5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:29.679125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be4507-5f9a-4735-827e-336c5d294595 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:29.705380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe85bb4-5d45-431b-b95b-c606c3b5cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:29.706541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85bb4-5d45-431b-b95b-c606c3b5cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:29.707068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85bb4-5d45-431b-b95b-c606c3b5cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:29.707612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85bb4-5d45-431b-b95b-c606c3b5cfd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:29.755581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:29.757586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:29.758398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:29.758996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:29.761528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:29.764283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:29.771299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 90/176] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:29 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:29.781051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:29.790098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:29.899038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe85bb4-5d45-431b-b95b-c606c3b5cfd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:29.903465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe85bb4-5d45-431b-b95b-c606c3b5cfd4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:29.952683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:30.034068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514074d-ed57-4c37-9846-eb94538057f9 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:30.049312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 87/177] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:30.050981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908bab-33d6-47ba-881f-543a719693a3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.051339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908bab-33d6-47ba-881f-543a719693a3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.051675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908bab-33d6-47ba-881f-543a719693a3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.058200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 88/178] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:30.058200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908bab-33d6-47ba-881f-543a719693a3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:30.114266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172b5ac-3b62-4f32-9326-1cd2730c0c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:30.116697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b5ac-3b62-4f32-9326-1cd2730c0c8a None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.117490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b5ac-3b62-4f32-9326-1cd2730c0c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.118536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b5ac-3b62-4f32-9326-1cd2730c0c8a None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91/users/9adf7afebb57471bbd6621bc85909958/roles/8298062094fc4491a06a7a486ebc3b42` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.123805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172b5ac-3b62-4f32-9326-1cd2730c0c8a None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a67e36889844dca6d15883832f5e91, user_id=9adf7afebb57471bbd6621bc85909958, role_id=8298062094fc4491a06a7a486ebc3b42)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:30.127284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172b5ac-3b62-4f32-9326-1cd2730c0c8a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:30.142326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:30.170778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908bab-33d6-47ba-881f-543a719693a3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:30.208160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:30.209063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.209318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.209592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] PATH_INFO: `/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.210978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd6181a80f44e8e8ee19d99255bb6e3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:30.213068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:30.214282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 91/179] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:29 2022] PUT /identity/v3/projects/d7a67e36889844dca6d15883832f5e91/users/9adf7afebb57471bbd6621bc85909958/roles/8298062094fc4491a06a7a486ebc3b42 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:24:30.215371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 89/180] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:30 2022] GET /identity/v3/projects/3bd6181a80f44e8e8ee19d99255bb6e3 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:30.216580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3ee7a-caf8-49c3-aac8-4851e8af63e3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.217020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3ee7a-caf8-49c3-aac8-4851e8af63e3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.217522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3ee7a-caf8-49c3-aac8-4851e8af63e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.221206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:30.239170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e0c3ee7a-caf8-49c3-aac8-4851e8af63e3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:30.240674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e0c3ee7a-caf8-49c3-aac8-4851e8af63e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:30.328729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:30.330296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa29-e11b-4d7d-a9bf-6fed302d2dc5 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.335634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa29-e11b-4d7d-a9bf-6fed302d2dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.335889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa29-e11b-4d7d-a9bf-6fed302d2dc5 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.338297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 93/182] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:30.344362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16906b58-2fe2-4be8-b43c-157f3e27ae66 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.344754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16906b58-2fe2-4be8-b43c-157f3e27ae66 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.345115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16906b58-2fe2-4be8-b43c-157f3e27ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.347904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f811d3-7fee-4924-a387-792a55f86277 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:30.378749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-16906b58-2fe2-4be8-b43c-157f3e27ae66 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:30.380150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-16906b58-2fe2-4be8-b43c-157f3e27ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:30.394620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:30.395637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.395777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.396059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.397149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=3bd6181a80f44e8e8ee19d99255bb6e3, user.id=194a4d4cc5174f9abf0af4c2de12d9c4) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:30.397468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:30.399227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:30.407753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 90/183] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:30 2022] GET /identity/v3/role_assignments?user.id=194a4d4cc5174f9abf0af4c2de12d9c4&scope.project.id=3bd6181a80f44e8e8ee19d99255bb6e3&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:30.408995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:30.421489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:30.451147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:30.489570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 94/184] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:30.489570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33aee9-badc-4df5-a620-b31b7df39c8a None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.490086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33aee9-badc-4df5-a620-b31b7df39c8a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.490086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33aee9-badc-4df5-a620-b31b7df39c8a None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.491970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 95/185] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:30.498692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2832b-129e-484f-bbe1-33fcfd911498 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.498995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2832b-129e-484f-bbe1-33fcfd911498 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.499470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2832b-129e-484f-bbe1-33fcfd911498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.523217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b6e2832b-129e-484f-bbe1-33fcfd911498 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:30.524563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b6e2832b-129e-484f-bbe1-33fcfd911498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:30.558974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf245fed-186f-4956-aca2-0317accbaad0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:30.629164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:30.631036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.631791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.632537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.640316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 96/186] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:30.641184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2832b-129e-484f-bbe1-33fcfd911498 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:30.655932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:30.671739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:30.672747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:30.673539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:30.674504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 91/187] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:30.676024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:30.803847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:30.811340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2832b-129e-484f-bbe1-33fcfd911498 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:30.823574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:30.859943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369eb1e-b2a7-4a09-bf04-e2825f82a5cc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:30.864596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:30.866262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.866620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.867335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.869538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:30.872648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:30.876059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 97/188] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:30.885291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:30.905730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:30.906948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:30.907237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:30.907813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:30.922835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:30.938988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:30.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:30.940755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:30.941394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 92/189] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:24:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:30.942756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:31.067930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f607cb6-2372-46ab-afb2-39ee0b7639d3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:31.118895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d98d0-fb2d-449f-a71d-79b01a3b489d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:31.131546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:31.132732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:31.133238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:31.133771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:31.135914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:31.136381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:31.139094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:31.153734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 98/190] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:31.155872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:31.169082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:31.182245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:31.183141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:31.183581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:31.183991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:31.185029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:31.186961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:31.238964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:31.312253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 93/191] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:24:30 2022] POST /identity/v3/users => generated 297 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:31.314348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:31.341883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fa7a8-1541-4289-bca0-6bd423fb5299 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:31.416269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:31.417960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:31.418287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:31.418967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:31.420678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:31.421599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:31.424404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:31.442109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 99/192] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:24:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:31.451620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:31.522186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcc69-ff42-4d57-8f0b-e3a96d9d822b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:31.566747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:31.567757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:31.567919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:31.568216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] PATH_INFO: `/v3/users/ca82311160d046799a7a1793828ea06f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:31.585818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=ca82311160d046799a7a1793828ea06f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:31.587938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:31.589859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 94/193] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:31 2022] GET /identity/v3/users/ca82311160d046799a7a1793828ea06f => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:31.599693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:31.651670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:31.656540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a723bc-0c39-447d-bb26-e538556d376d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:31.693672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:31.737315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:31.738837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:31.739288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:31.739724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] PATH_INFO: `/v3/users/ca82311160d046799a7a1793828ea06f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:31.742936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ca82311160d046799a7a1793828ea06f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:31.745872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:31.748459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 100/194] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:31 2022] GET /identity/v3/users/ca82311160d046799a7a1793828ea06f => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:31.756687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:31.811947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a576-fed9-4310-aeca-67bcd1e0c5b9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:31.861991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:31.863049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:31.863530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:31.864020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:31.972860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:31.974768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:31.975594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d14043-7e00-4ef5-9a30-af81a675e2d2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:32.026252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:32.047436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:32.048473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:32.048938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:32.055588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:32.106075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 95/195] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:32.112292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:32.120817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:32.213629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:32.216659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:32.239575 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e4648-a4a0-488b-9585-75c67595bcc6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:32.293789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:32.294751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:32.295031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:32.295302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:32.301247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:32.304710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:32.311673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 96/196] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:32 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:32.322539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:32.345831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:32.479099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 101/197] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:24:32.484809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:32.514270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e2c8a-cbb8-4908-8167-e787e5667c4f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:32.576314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:32.591112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3d64f-c5b2-4e3e-a5ae-fc243fe881d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:32.595149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d64f-c5b2-4e3e-a5ae-fc243fe881d0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:32.595897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d64f-c5b2-4e3e-a5ae-fc243fe881d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:32.600994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d64f-c5b2-4e3e-a5ae-fc243fe881d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:32.603137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3d64f-c5b2-4e3e-a5ae-fc243fe881d0 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=ca82311160d046799a7a1793828ea06f) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:32.603962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3d64f-c5b2-4e3e-a5ae-fc243fe881d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:32.607138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3d64f-c5b2-4e3e-a5ae-fc243fe881d0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:32.627930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 97/198] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:32 2022] GET /identity/v3/role_assignments?user.id=ca82311160d046799a7a1793828ea06f&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:32.670192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982cf9-6497-4cd2-bde9-31bed5b88899 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:32.717523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658754-6191-4ef4-8e9e-94a0deacb446 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:32.717862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658754-6191-4ef4-8e9e-94a0deacb446 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:32.718128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658754-6191-4ef4-8e9e-94a0deacb446 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:32.719533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 98/199] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:32.727146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d4cb-e2ff-41ec-a7bb-bde58d652ce6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:32.727447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d4cb-e2ff-41ec-a7bb-bde58d652ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:32.728320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d4cb-e2ff-41ec-a7bb-bde58d652ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:32.766423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:32.767972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:32.768504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:32.769029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:32.771683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:32.775185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:32.775498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-87e9d4cb-e2ff-41ec-a7bb-bde58d652ce6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:32.776705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-87e9d4cb-e2ff-41ec-a7bb-bde58d652ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:32.779419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 102/200] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:32 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:32.786481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:32.942034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 99/201] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:33.005200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d4cb-e2ff-41ec-a7bb-bde58d652ce6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:33.011448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:33.031899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdf75c-2798-46eb-bd7c-633fe6bf7600 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:33.094820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:33.096456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:33.097986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:33.098773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:33.100681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] RBAC: Adding query filter params (role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=ca82311160d046799a7a1793828ea06f) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:33.101536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:33.107292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:33.113330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:33.120727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 103/202] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:32 2022] GET /identity/v3/role_assignments?user.id=ca82311160d046799a7a1793828ea06f&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=fb047c0afbd247f98f75175d913fed8e => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:33.229557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d4cb-e2ff-41ec-a7bb-bde58d652ce6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:33.367632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:33.369180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:33.369462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:33.369761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:33.394410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:33.409533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:33.412257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:33.413870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 100/203] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:33.427539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:33.718735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809a733-bad4-453b-8565-d79df3c8d79c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:33.817907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:33.819088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:33.819619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:33.820131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:33.821747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:33.822330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:33.825056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:33.847437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 104/204] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:33.854456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:33.995938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:34.093111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaed61-7080-4571-8770-97f50fda724d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:34.179517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2879ae5-2735-4f73-9f38-51aba8677542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:34.181123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2879ae5-2735-4f73-9f38-51aba8677542 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:34.181637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2879ae5-2735-4f73-9f38-51aba8677542 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:34.182176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2879ae5-2735-4f73-9f38-51aba8677542 None admin] PATH_INFO: `/v3/users/9adf7afebb57471bbd6621bc85909958` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:34.184527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2879ae5-2735-4f73-9f38-51aba8677542 None admin] RBAC: Authorizing `identity:get_user(user_id=9adf7afebb57471bbd6621bc85909958)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:34.187467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2879ae5-2735-4f73-9f38-51aba8677542 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:34.190796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 101/205] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:33 2022] GET /identity/v3/users/9adf7afebb57471bbd6621bc85909958 => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:34.197379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:34.310293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:34.369339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fca19-6586-48b1-a6e7-3b6e60cea84f None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:34.421426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:34.422126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:34.422415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:34.422702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:34.510569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb745c5-a392-470d-942b-987e54eb196e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:34.511205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb745c5-a392-470d-942b-987e54eb196e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:34.511716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb745c5-a392-470d-942b-987e54eb196e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:34.513351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 102/206] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:34.519289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaba53-396b-4bf4-a39c-272092f3ca79 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:34.519945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaba53-396b-4bf4-a39c-272092f3ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:34.520433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaba53-396b-4bf4-a39c-272092f3ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:34.526837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:34.528506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:34.565890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-63eaba53-396b-4bf4-a39c-272092f3ca79 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:34.567481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-63eaba53-396b-4bf4-a39c-272092f3ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:34.630051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:34.712844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 105/207] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:34.718644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:34.766312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 103/208] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:34.801638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaba53-396b-4bf4-a39c-272092f3ca79 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:34.947401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:35.002081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4dc13-de9e-4371-baa3-68c66d153f67 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:35.038956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaba53-396b-4bf4-a39c-272092f3ca79 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:35.081377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925114b-6d8d-48b0-8594-b59b4998b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:35.082535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925114b-6d8d-48b0-8594-b59b4998b83c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.082964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925114b-6d8d-48b0-8594-b59b4998b83c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.083379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925114b-6d8d-48b0-8594-b59b4998b83c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.099980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925114b-6d8d-48b0-8594-b59b4998b83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:35.107857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6e7c2-dc2d-406a-a073-eb0a289058b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:35.108746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e7c2-dc2d-406a-a073-eb0a289058b2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.109202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e7c2-dc2d-406a-a073-eb0a289058b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.109629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e7c2-dc2d-406a-a073-eb0a289058b2 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.111142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6e7c2-dc2d-406a-a073-eb0a289058b2 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c925114b-6d8d-48b0-8594-b59b4998b83c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:35.111272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:35.112252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:35.113098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 104/209] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:35.113827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fed4b-1b6c-480d-8f96-759ba3d41640 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.114254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fed4b-1b6c-480d-8f96-759ba3d41640 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.114655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fed4b-1b6c-480d-8f96-759ba3d41640 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.116456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 105/210] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:35.120635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6e7c2-dc2d-406a-a073-eb0a289058b2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:35.121913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fed4b-1b6c-480d-8f96-759ba3d41640 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:35.128167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 106/211] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:34 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:35.129838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824645-279e-414e-898e-c15891b65837 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.130355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824645-279e-414e-898e-c15891b65837 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.130833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824645-279e-414e-898e-c15891b65837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.152222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-01824645-279e-414e-898e-c15891b65837 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:35.154367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-01824645-279e-414e-898e-c15891b65837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:35.188148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:35.246244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 107/212] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:35.247159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824645-279e-414e-898e-c15891b65837 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:35.268510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fed4b-1b6c-480d-8f96-759ba3d41640 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:35.298092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:35.318393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:35.319277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.319673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.320023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.321226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:35.321728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:35.324364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:35.337407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 106/213] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:35.339620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:35.394080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824645-279e-414e-898e-c15891b65837 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:35.438190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:35.438862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.439152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.439431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.440292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] RBAC: Adding query filter params (role.id=8298062094fc4491a06a7a486ebc3b42, scope.project.id=d7a67e36889844dca6d15883832f5e91, user.id=9adf7afebb57471bbd6621bc85909958) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:35.440607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:35.442147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:35.450992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 108/214] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:35 2022] GET /identity/v3/role_assignments?user.id=9adf7afebb57471bbd6621bc85909958&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=8298062094fc4491a06a7a486ebc3b42 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:35.451857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:35.521398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0a11-078c-4aca-8741-0a4a4c0c2cf8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:35.527368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:35.575039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:35.576892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.577546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.578216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.580418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:35.584114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:35.586467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 107/215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:35.600451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:35.669585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:35.732231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a84c9c-a077-4085-8f3d-fcfa8ce92794 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:35.738542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d84215-debc-4b3d-a04f-4366daeb6229 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:35.786826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9cccc-2a4f-4e65-a7e1-ced6dc1dc33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:35.787821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9cccc-2a4f-4e65-a7e1-ced6dc1dc33c None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.788279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9cccc-2a4f-4e65-a7e1-ced6dc1dc33c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.788731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9cccc-2a4f-4e65-a7e1-ced6dc1dc33c None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.789653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9cccc-2a4f-4e65-a7e1-ced6dc1dc33c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:35.792538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9cccc-2a4f-4e65-a7e1-ced6dc1dc33c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:35.806976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d749d-c712-47c1-af71-1e3b801dedc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:35.808655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d749d-c712-47c1-af71-1e3b801dedc6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.809165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d749d-c712-47c1-af71-1e3b801dedc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.809771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d749d-c712-47c1-af71-1e3b801dedc6 None admin] PATH_INFO: `/v3/users/1256c92323804879932d6348fab65ef8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.835816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d749d-c712-47c1-af71-1e3b801dedc6 None admin] RBAC: Authorizing `identity:get_user(user_id=1256c92323804879932d6348fab65ef8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:35.838718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d749d-c712-47c1-af71-1e3b801dedc6 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:35.842058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 109/216] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:35 2022] GET /identity/v3/users/1256c92323804879932d6348fab65ef8 => generated 297 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:35.844286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23dc0-1171-419d-a11f-bcd3abac1ffb None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.844813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23dc0-1171-419d-a11f-bcd3abac1ffb None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.845328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23dc0-1171-419d-a11f-bcd3abac1ffb None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.849742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 110/217] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:35.849742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23dc0-1171-419d-a11f-bcd3abac1ffb None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:35.918433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 108/218] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:24:35 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:24:35.920203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d4dae-9936-4f8f-a502-ced69c29460b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:35.920652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d4dae-9936-4f8f-a502-ced69c29460b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:35.921482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d4dae-9936-4f8f-a502-ced69c29460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:35.963276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-199d4dae-9936-4f8f-a502-ced69c29460b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:35.965439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-199d4dae-9936-4f8f-a502-ced69c29460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:36.025382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:36.072231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23dc0-1171-419d-a11f-bcd3abac1ffb None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:36.117515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 109/219] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:36.142364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1f325-455e-447e-a9b3-452767920917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:36.143551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1f325-455e-447e-a9b3-452767920917 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:36.144064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1f325-455e-447e-a9b3-452767920917 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:36.144648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1f325-455e-447e-a9b3-452767920917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:36.155864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d4dae-9936-4f8f-a502-ced69c29460b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:36.212597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:36.279201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1f325-455e-447e-a9b3-452767920917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:36.280882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1f325-455e-447e-a9b3-452767920917 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:36.332056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d4dae-9936-4f8f-a502-ced69c29460b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:36.389370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16163e58-d2f5-4d24-b889-86514001fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:36.390712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163e58-d2f5-4d24-b889-86514001fc11 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:36.391024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163e58-d2f5-4d24-b889-86514001fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:36.391263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163e58-d2f5-4d24-b889-86514001fc11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:36.408330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:36.409584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16163e58-d2f5-4d24-b889-86514001fc11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-16163e58-d2f5-4d24-b889-86514001fc11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:36.420267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:36.424367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 110/220] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:36.426577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8299b-3151-4328-87e3-f9744bf28ae7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:36.428997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8299b-3151-4328-87e3-f9744bf28ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:36.428997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8299b-3151-4328-87e3-f9744bf28ae7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:36.434086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 111/221] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:36.434086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8299b-3151-4328-87e3-f9744bf28ae7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:36.453520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 111/222] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:36.454969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957483a-0914-4df0-b97b-02414308f1ee None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:36.455273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957483a-0914-4df0-b97b-02414308f1ee None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:36.455545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957483a-0914-4df0-b97b-02414308f1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:36.474842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d957483a-0914-4df0-b97b-02414308f1ee None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:36.476104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d957483a-0914-4df0-b97b-02414308f1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:36.601810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 112/223] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:36.601810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957483a-0914-4df0-b97b-02414308f1ee None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:36.642018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:36.651723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8299b-3151-4328-87e3-f9744bf28ae7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:36.693323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:36.694400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:36.694846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:36.695281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:36.696300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:36.696991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:36.698986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:36.708774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 112/224] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:36.714835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:36.813205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957483a-0914-4df0-b97b-02414308f1ee None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:36.834065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d613c5-8084-4d01-8e37-093ac3493956 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:36.840266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:36.878551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:36.879892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:36.880334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:36.880772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:36.881835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:36.882823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:36.883043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:36.883564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:36.884185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:36.885429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:36.894387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 113/225] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:36 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:36.895711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:36.898036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:36.909665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:36.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:36.911615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:36.915523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 113/226] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:24:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:36.923026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:36.954597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:37.056550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260e4e4-241f-46aa-994a-ff22caea7e01 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:37.089203 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28878a-9493-4543-ad57-32454a7d169a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:37.100827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:37.101835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:37.102306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:37.103254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:37.104381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=1256c92323804879932d6348fab65ef8) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:37.104879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:37.106643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:37.113550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 114/227] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:36 2022] GET /identity/v3/role_assignments?user.id=1256c92323804879932d6348fab65ef8&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:37.114694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:37.197726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:37.199215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:37.199734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:37.200248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] PATH_INFO: `/v3/users/ca82311160d046799a7a1793828ea06f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:37.207722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca82311160d046799a7a1793828ea06f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:37.210148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:37.214421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 114/228] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:36 2022] GET /identity/v3/users/ca82311160d046799a7a1793828ea06f => generated 283 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:37.220483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:37.223103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:37.245776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54a7e-9d1c-4da7-98f3-33e23d5c1452 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:37.289003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:37.290567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:37.291138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:37.291635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:37.292703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:37.293261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:37.295134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:37.306256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 115/229] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:37.312354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:37.359159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:37.482821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a3acc-e678-42b1-a953-b60b6c65ede5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:37.557020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21a8e-99a9-4d0d-a0a8-58045f88c74f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:37.588526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:37.589908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:37.590398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:37.590870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:37.592422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:37.599858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:37.599858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 115/230] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:37 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:37.607142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:37.622684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:37.624069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:37.624579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:37.625147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] PATH_INFO: `/v3/users/ca82311160d046799a7a1793828ea06f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:37.627392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] RBAC: Authorizing `identity:get_user(user_id=ca82311160d046799a7a1793828ea06f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:37.630238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:37.634200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 116/231] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:37 2022] GET /identity/v3/users/ca82311160d046799a7a1793828ea06f => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:37.642333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:37.699640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:37.868568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1daec-cdec-422b-b64f-849cbbd668dd None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:37.927881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:37.937314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf162b-6593-4c78-9a0e-11ddd324e192 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:37.989425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44931751-8c24-4fb0-a547-8c0f7448eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:37.990808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44931751-8c24-4fb0-a547-8c0f7448eb7e None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:37.991196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44931751-8c24-4fb0-a547-8c0f7448eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:37.991575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44931751-8c24-4fb0-a547-8c0f7448eb7e None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112/users/ca82311160d046799a7a1793828ea06f/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:37.994455 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44931751-8c24-4fb0-a547-8c0f7448eb7e None admin] RBAC: Authorizing `identity:create_grant(project_id=59923365865346149b07f6c3fd58b112, user_id=ca82311160d046799a7a1793828ea06f, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:37.996676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44931751-8c24-4fb0-a547-8c0f7448eb7e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:38.020521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:38.022449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:38.023195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:38.031675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:38.031675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:38.031675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:38.034365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 117/232] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:37 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:38.043355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:38.115038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 116/233] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:37 2022] PUT /identity/v3/projects/59923365865346149b07f6c3fd58b112/users/ca82311160d046799a7a1793828ea06f/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:24:38.253559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:38.293100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd5349-e823-448b-af88-c7e3745b03d0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:38.374237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117c6b7-cb56-419e-a85b-e906ca7faef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:38.375814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c6b7-cb56-419e-a85b-e906ca7faef3 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:38.376316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c6b7-cb56-419e-a85b-e906ca7faef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:38.376842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c6b7-cb56-419e-a85b-e906ca7faef3 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112/users/ca82311160d046799a7a1793828ea06f/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:38.381054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117c6b7-cb56-419e-a85b-e906ca7faef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=59923365865346149b07f6c3fd58b112, user_id=ca82311160d046799a7a1793828ea06f, role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:38.384646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117c6b7-cb56-419e-a85b-e906ca7faef3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:38.510447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 118/234] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:38 2022] PUT /identity/v3/projects/59923365865346149b07f6c3fd58b112/users/ca82311160d046799a7a1793828ea06f/roles/fb047c0afbd247f98f75175d913fed8e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:38.755030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a0d22-bcd8-4226-80b1-14efeb4649c3 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:38.756072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a0d22-bcd8-4226-80b1-14efeb4649c3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:38.756373 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a0d22-bcd8-4226-80b1-14efeb4649c3 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:38.758253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 117/235] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:38.768742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ead5b-647f-429d-95ee-f41c12b7194c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:38.768988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ead5b-647f-429d-95ee-f41c12b7194c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:38.769284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ead5b-647f-429d-95ee-f41c12b7194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:38.798790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-319ead5b-647f-429d-95ee-f41c12b7194c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:38.800022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-319ead5b-647f-429d-95ee-f41c12b7194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:38.956549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 119/236] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:38.992844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a0d22-bcd8-4226-80b1-14efeb4649c3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:39.132813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a0d22-bcd8-4226-80b1-14efeb4649c3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:39.185181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:39.186036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:39.186313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:39.186586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:39.203947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:39.212732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:39.214553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:39.216753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:39.218565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 118/237] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:39.223833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ead5b-647f-429d-95ee-f41c12b7194c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:39.393493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:39.452542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ead5b-647f-429d-95ee-f41c12b7194c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:39.533542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63cde-172f-4405-960c-a529e58619cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:39.534717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63cde-172f-4405-960c-a529e58619cc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:39.535218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63cde-172f-4405-960c-a529e58619cc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:39.535710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63cde-172f-4405-960c-a529e58619cc None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:39.537153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63cde-172f-4405-960c-a529e58619cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:39.537732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63cde-172f-4405-960c-a529e58619cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:39.543501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63cde-172f-4405-960c-a529e58619cc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:39.557719 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 120/238] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:39.566796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:39.659811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:39.804916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db9169-1ba5-4e45-9dfb-7597a8b893f5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:39.827415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734f99-ffb1-4044-8245-001f33cfe9f0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:39.827918 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734f99-ffb1-4044-8245-001f33cfe9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:39.828407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734f99-ffb1-4044-8245-001f33cfe9f0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:39.838322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 121/239] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:39.847608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81637-6d36-4c3b-8016-a0e0309cb203 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:39.848107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81637-6d36-4c3b-8016-a0e0309cb203 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:39.848603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81637-6d36-4c3b-8016-a0e0309cb203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:39.862103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:39.863656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:39.864099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:39.864522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] PATH_INFO: `/v3/users/e847986016314bf19e047dcd5926d8f8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:39.900649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-37c81637-6d36-4c3b-8016-a0e0309cb203 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:39.902789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-37c81637-6d36-4c3b-8016-a0e0309cb203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:39.916239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=e847986016314bf19e047dcd5926d8f8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:39.919565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:39.922911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 119/240] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:39 2022] GET /identity/v3/users/e847986016314bf19e047dcd5926d8f8 => generated 297 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:39.933161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:40.084376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 122/241] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:40.092544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:40.100598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca673-e10f-4d14-88a1-89030c4f0ef9 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:40.150194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81637-6d36-4c3b-8016-a0e0309cb203 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:40.150933 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3000ab-62f1-4a6f-9626-452116289f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:40.151830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3000ab-62f1-4a6f-9626-452116289f40 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:40.152276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3000ab-62f1-4a6f-9626-452116289f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:40.152709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3000ab-62f1-4a6f-9626-452116289f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:40.314237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:40.323716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3000ab-62f1-4a6f-9626-452116289f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:40.326884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3000ab-62f1-4a6f-9626-452116289f40 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:40.388656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81637-6d36-4c3b-8016-a0e0309cb203 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:40.447624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d06d0-5334-48d5-a0a1-40cc6188e079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:40.449027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d06d0-5334-48d5-a0a1-40cc6188e079 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:40.449516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d06d0-5334-48d5-a0a1-40cc6188e079 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:40.450046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d06d0-5334-48d5-a0a1-40cc6188e079 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:40.452647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d06d0-5334-48d5-a0a1-40cc6188e079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:40.455774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d06d0-5334-48d5-a0a1-40cc6188e079 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:40.459327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 123/242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:40.469663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ffbf4-d3cc-4ef0-994b-e7bc06b12fd3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:40.470297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ffbf4-d3cc-4ef0-994b-e7bc06b12fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:40.470794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ffbf4-d3cc-4ef0-994b-e7bc06b12fd3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:40.473712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 124/243] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:40.475481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ffbf4-d3cc-4ef0-994b-e7bc06b12fd3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:40.501206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:40.509508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 120/244] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:24:40.511184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92eb96-34c7-4ec0-8e7f-511bf8ade3a5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:40.511545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92eb96-34c7-4ec0-8e7f-511bf8ade3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:40.511888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92eb96-34c7-4ec0-8e7f-511bf8ade3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:40.538822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8a92eb96-34c7-4ec0-8e7f-511bf8ade3a5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:40.543689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8a92eb96-34c7-4ec0-8e7f-511bf8ade3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:40.640867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 121/245] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:40.647113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92eb96-34c7-4ec0-8e7f-511bf8ade3a5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:40.707069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ffbf4-d3cc-4ef0-994b-e7bc06b12fd3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:40.758123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:40.768289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:40.774650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92eb96-34c7-4ec0-8e7f-511bf8ade3a5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:40.774822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:40.774822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:40.774822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:40.774822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:40.774822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:40.800821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:40.812622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:40.813622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:40.814026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:40.814376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:40.815765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:40.817414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:40.819617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 122/246] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:40 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:40.820292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:40.873871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 125/247] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:24:40 2022] POST /identity/v3/users => generated 293 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:40.874918 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:41.010033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6bb9d-e59b-42bf-87d3-5b59a1dd6165 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:41.088619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8c9f-8353-42d0-9f82-970e86caaadc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:41.126839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:41.128152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:41.128605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:41.129045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:41.130014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:41.130701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:41.130989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:41.131271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:41.132146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] RBAC: Adding query filter params (role.id=8298062094fc4491a06a7a486ebc3b42, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=e847986016314bf19e047dcd5926d8f8) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:41.132465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:41.134721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:41.141718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 126/248] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:40 2022] GET /identity/v3/role_assignments?user.id=e847986016314bf19e047dcd5926d8f8&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=8298062094fc4491a06a7a486ebc3b42 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:41.170977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:41.191010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:41.192237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:41.193670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 123/249] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:41.202512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:41.297163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:41.374394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571199b-b6f8-46b8-8fd7-e08ce7b5f409 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:41.433807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284373-031c-40e0-95e6-f9150cdbc4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:41.434898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284373-031c-40e0-95e6-f9150cdbc4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:41.435380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284373-031c-40e0-95e6-f9150cdbc4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:41.435850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284373-031c-40e0-95e6-f9150cdbc4f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:41.436856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284373-031c-40e0-95e6-f9150cdbc4f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:41.437171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284373-031c-40e0-95e6-f9150cdbc4f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:41.438676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284373-031c-40e0-95e6-f9150cdbc4f0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:41.449900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 127/250] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:41.459275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:41.554056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d36d-cea8-4748-945a-c26ec016eefa None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:41.554293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d36d-cea8-4748-945a-c26ec016eefa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:41.554614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d36d-cea8-4748-945a-c26ec016eefa None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:41.556473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 128/251] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:41.562471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b513-6853-4ef8-91d0-45c134a1361a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:41.562880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b513-6853-4ef8-91d0-45c134a1361a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:41.563031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b513-6853-4ef8-91d0-45c134a1361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:41.563823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:41.583917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3e74b513-6853-4ef8-91d0-45c134a1361a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:41.585213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3e74b513-6853-4ef8-91d0-45c134a1361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:41.668348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3618cd-8e57-4271-b698-42c3705f3149 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:41.703580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 129/252] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:41.732669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:41.734752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:41.735568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:41.736352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] PATH_INFO: `/v3/users/1256c92323804879932d6348fab65ef8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:41.741327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74b513-6853-4ef8-91d0-45c134a1361a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:41.741560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=1256c92323804879932d6348fab65ef8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:41.742758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:41.744981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 124/253] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:41 2022] GET /identity/v3/users/1256c92323804879932d6348fab65ef8 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:41.753482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:41.862338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:41.972740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74b513-6853-4ef8-91d0-45c134a1361a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:41.973299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaae67-8c2a-44ce-a52f-17886e7ec5d2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:42.002432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:42.018484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:42.019407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.019702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.019990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.021363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:42.022953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:42.025496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 125/254] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:41 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:42.039471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:42.147010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:42.148320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.149004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.149540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.174889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128e8d9-6595-492e-95a6-82a2c307c5ef None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:42.203111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:42.223874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:42.236606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:42.238721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 130/255] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 497 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:42.247589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:42.271989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111046c6-65bf-4362-ae20-f8a7265528c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:42.273319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111046c6-65bf-4362-ae20-f8a7265528c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.274506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111046c6-65bf-4362-ae20-f8a7265528c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.275224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111046c6-65bf-4362-ae20-f8a7265528c5 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112/users/1256c92323804879932d6348fab65ef8/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.277947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111046c6-65bf-4362-ae20-f8a7265528c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=59923365865346149b07f6c3fd58b112, user_id=1256c92323804879932d6348fab65ef8, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:42.279873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111046c6-65bf-4362-ae20-f8a7265528c5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:42.376642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 126/256] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:42 2022] PUT /identity/v3/projects/59923365865346149b07f6c3fd58b112/users/1256c92323804879932d6348fab65ef8/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:24:42.378389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f535c-9d74-4194-8f90-0c5cc3a334f6 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.378892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f535c-9d74-4194-8f90-0c5cc3a334f6 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.384902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f535c-9d74-4194-8f90-0c5cc3a334f6 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.387169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 127/257] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:42.396869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffaead-eb62-4459-845c-fe7229f6b803 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.397552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffaead-eb62-4459-845c-fe7229f6b803 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.398052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffaead-eb62-4459-845c-fe7229f6b803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.432828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d0ffaead-eb62-4459-845c-fe7229f6b803 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:42.434504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d0ffaead-eb62-4459-845c-fe7229f6b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:42.481715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89a0c-02b9-4489-809f-d6f48372df91 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:42.481715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:42.549149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:42.557992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:42.559110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.559613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.560057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.561435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:42.561967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:42.564505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:42.580265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 128/258] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:42.583947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 131/259] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:42.590314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffaead-eb62-4459-845c-fe7229f6b803 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:42.641506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:42.795115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffaead-eb62-4459-845c-fe7229f6b803 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:42.856777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:42.858250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.860340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771b62-6426-4e0a-91d3-ef35519aa542 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:42.860869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.861351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] PATH_INFO: `/v3/users/ca82311160d046799a7a1793828ea06f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.864877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] RBAC: Authorizing `identity:get_user(user_id=ca82311160d046799a7a1793828ea06f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:42.868755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:42.876370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 129/260] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:42 2022] GET /identity/v3/users/ca82311160d046799a7a1793828ea06f => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:42.886047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:42.942509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:42.944587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:42.945281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:42.947771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:42.972246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:42.984285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:42.985228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:42.986091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:42.990585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 132/261] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:24:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:42.998858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:42.999787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:43.056300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:43.119058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c55e0-c3e0-4bf2-8b80-25a9f2b30001 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:43.204007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:43.205234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:43.207255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:43.207792 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:43.227797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f1b4f-2e14-4358-961e-e9afef8a0f74 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:43.313021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:43.314979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:43.374496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:43.375211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:43.375498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:43.375777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:43.376556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:43.376867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:43.378326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:43.381117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:43.397695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 133/262] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:24:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:43.402538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:43.494913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 130/263] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:24:43.512503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:43.595689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:43.636273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24db1-94d0-49e0-b1c4-d4840f3f1429 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:43.710684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:43.712802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:43.713095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:43.713377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] PATH_INFO: `/v3/users/ca82311160d046799a7a1793828ea06f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:43.719413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] RBAC: Authorizing `identity:get_user(user_id=ca82311160d046799a7a1793828ea06f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:43.720884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:43.728659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 134/264] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:43 2022] GET /identity/v3/users/ca82311160d046799a7a1793828ea06f => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:43.734582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:43.760871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e952-f8d3-4b3f-883d-5a44299d6c68 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:43.807782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:43.808720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:43.809005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:43.809279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:43.810617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:43.812135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:43.814044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 131/265] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:43 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:43.820201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:43.848297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:43.972834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df225f1-c5cc-4d80-a7bf-fcfdb2544f2e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:43.990865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9fe5d-a97c-44dd-ade1-ec9c7a0c07ca None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:44.057936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:44.059517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:44.059797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:44.060078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:44.060952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=ca82311160d046799a7a1793828ea06f) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:44.061266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:44.062815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:44.075604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:44.076296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:44.076580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:44.076851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:44.080656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 132/266] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:43 2022] GET /identity/v3/role_assignments?user.id=ca82311160d046799a7a1793828ea06f&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:44.126859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:44.196797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:44.198415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:44.345117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 135/267] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:24:44.351204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:44.470402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:44.488180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e78ef-6ded-416e-942b-00f96217fadc None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:44.531357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ef7f-727a-49fc-852d-990caf71955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:44.532283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef7f-727a-49fc-852d-990caf71955c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:44.533063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef7f-727a-49fc-852d-990caf71955c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:44.533340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef7f-727a-49fc-852d-990caf71955c None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:44.535130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140ef7f-727a-49fc-852d-990caf71955c None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:44.536637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140ef7f-727a-49fc-852d-990caf71955c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:44.538803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 133/268] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:44 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:44.549020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:44.653373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:44.718265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819a8e2-3108-47e5-8528-16588b92cb9e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:44.771991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:44.772569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:44.772849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:44.773124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:44.775921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173853d-9575-4082-bac3-dc148d32202d None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:44.776336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173853d-9575-4082-bac3-dc148d32202d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:44.776621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173853d-9575-4082-bac3-dc148d32202d None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:44.778090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 134/269] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:24:44.779263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] RBAC: Adding query filter params (role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=ca82311160d046799a7a1793828ea06f) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:44.785207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:44.785207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:44.798040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 136/270] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:44 2022] GET /identity/v3/role_assignments?user.id=ca82311160d046799a7a1793828ea06f&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=fb047c0afbd247f98f75175d913fed8e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:44.805845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e56b-dd7f-4291-b2c7-3b7596af53f5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:44.806841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e56b-dd7f-4291-b2c7-3b7596af53f5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:44.807371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e56b-dd7f-4291-b2c7-3b7596af53f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:44.842626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a156e56b-dd7f-4291-b2c7-3b7596af53f5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:44.844458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a156e56b-dd7f-4291-b2c7-3b7596af53f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:44.981339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 135/271] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:45.062011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:45.200464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998364-d325-4fc4-bd20-7ebd5e6082e9 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.201491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998364-d325-4fc4-bd20-7ebd5e6082e9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.202008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998364-d325-4fc4-bd20-7ebd5e6082e9 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.203906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 136/272] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:45.209736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459428-5bef-4233-a1ea-6e6e49371a8c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.210373 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459428-5bef-4233-a1ea-6e6e49371a8c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.210874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459428-5bef-4233-a1ea-6e6e49371a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.234943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ee459428-5bef-4233-a1ea-6e6e49371a8c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:45.237250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ee459428-5bef-4233-a1ea-6e6e49371a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:45.313082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6923e-5941-49d7-90b3-97e994e22097 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:45.351072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:45.370775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 137/273] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:45.374034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df239f-bdc2-41e8-9e18-f853a4dc7c19 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.374932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df239f-bdc2-41e8-9e18-f853a4dc7c19 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.375720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df239f-bdc2-41e8-9e18-f853a4dc7c19 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.380102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:45.380873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 138/274] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:45.385714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.385714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.385714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.390162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53a27-16c5-4280-9c36-9ca5d57f8d65 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.391038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53a27-16c5-4280-9c36-9ca5d57f8d65 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.391821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53a27-16c5-4280-9c36-9ca5d57f8d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.407222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:45.415410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:45.423130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:45.424111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:45.424952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:45.434273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-abc53a27-16c5-4280-9c36-9ca5d57f8d65 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:45.434466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 137/275] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:45.434466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:45.434611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-abc53a27-16c5-4280-9c36-9ca5d57f8d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:45.545872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 139/276] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:45.547096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc53a27-16c5-4280-9c36-9ca5d57f8d65 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:45.617928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa938-2458-4b47-bd6b-a5024e644271 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:45.683925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:45.685446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.686044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.686552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.689404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:45.691543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:45.700246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 138/277] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:45.700246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:45.716954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc53a27-16c5-4280-9c36-9ca5d57f8d65 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:45.780699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:45.781690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.782128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.782565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.783739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:45.784230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:45.786218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:45.786486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:45.791200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:45.811007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 140/278] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:45.811007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:45.869659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e9b4e-1f5d-4c66-b683-70cc0a544213 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:45.909562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:45.910928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:45.911375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:45.911862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:45.932608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:45.948307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:45.949576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:45.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 139/279] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:45.952700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:45.958714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f416-b788-490a-9d7d-e3c098a5ce16 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:46.001923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c1db9-9ad7-42a7-ba3a-7f0680a0da34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:46.002768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1db9-9ad7-42a7-ba3a-7f0680a0da34 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:46.003149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1db9-9ad7-42a7-ba3a-7f0680a0da34 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:46.003522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1db9-9ad7-42a7-ba3a-7f0680a0da34 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:46.004335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c1db9-9ad7-42a7-ba3a-7f0680a0da34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:46.006092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c1db9-9ad7-42a7-ba3a-7f0680a0da34 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:46.075268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96384b9-8626-4ed0-948b-ea11719893ff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:46.082941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:46.099752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 141/280] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:24:45 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:46.115529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a80cc-2d45-4e80-a06b-381f296e7e99 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:46.115992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a80cc-2d45-4e80-a06b-381f296e7e99 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:46.116453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a80cc-2d45-4e80-a06b-381f296e7e99 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:46.120623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 142/281] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:46 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:46.120623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a80cc-2d45-4e80-a06b-381f296e7e99 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:46.122496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1f1d3-f681-4938-ac5d-e5f963628e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:46.123919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f1d3-f681-4938-ac5d-e5f963628e67 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:46.124385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f1d3-f681-4938-ac5d-e5f963628e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:46.124839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f1d3-f681-4938-ac5d-e5f963628e67 None admin] PATH_INFO: `/v3/users/62f80753c2704075b54d5e4397d7b4a4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:46.152526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1f1d3-f681-4938-ac5d-e5f963628e67 None admin] RBAC: Authorizing `identity:get_user(user_id=62f80753c2704075b54d5e4397d7b4a4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:46.155178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1f1d3-f681-4938-ac5d-e5f963628e67 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:46.158227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 140/282] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:45 2022] GET /identity/v3/users/62f80753c2704075b54d5e4397d7b4a4 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:46.160106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d512c1-fe4d-40d1-995e-94e7cdb07e21 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:46.161245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d512c1-fe4d-40d1-995e-94e7cdb07e21 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:46.162275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d512c1-fe4d-40d1-995e-94e7cdb07e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:46.192541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-06d512c1-fe4d-40d1-995e-94e7cdb07e21 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:46.194597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-06d512c1-fe4d-40d1-995e-94e7cdb07e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:46.232506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:46.322513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 141/283] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:46.323952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d512c1-fe4d-40d1-995e-94e7cdb07e21 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:46.330648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a80cc-2d45-4e80-a06b-381f296e7e99 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:46.398691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:46.400738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:46.401204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:46.401702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:46.403065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:46.403576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:46.406177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:46.424589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 143/284] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:46.427202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:46.512491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:46.532581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d512c1-fe4d-40d1-995e-94e7cdb07e21 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:46.598015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:46.599587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:46.600523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:46.601434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:46.603998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, user.id=62f80753c2704075b54d5e4397d7b4a4, scope.system=all) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:46.604982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:46.608205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:46.608610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a255-3202-42f1-b753-a4e9a2388e66 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:46.620060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 142/285] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 08:24:46 2022] GET /identity/v3/role_assignments?user.id=62f80753c2704075b54d5e4397d7b4a4&scope.system=all&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:46.622082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:46.631893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:46.685939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:46.687973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:46.688714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:46.690657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:46.718793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:46.727626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:46.728975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:46.729811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 144/286] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:46.735378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:46.909060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c19b-0dd4-49c3-a248-bb7850de3d50 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:47.002631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195673-1cda-4fe3-b020-112bba121280 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:47.011431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:47.012705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:47.013205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:47.013695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] PATH_INFO: `/v3/users/e847986016314bf19e047dcd5926d8f8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:47.018810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] RBAC: Authorizing `identity:get_user(user_id=e847986016314bf19e047dcd5926d8f8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:47.020670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:47.022810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 143/287] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:46 2022] GET /identity/v3/users/e847986016314bf19e047dcd5926d8f8 => generated 297 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:47.041873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:47.080428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:47.081623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:47.082847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:47.083355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:47.085027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:47.085732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:47.090707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:47.107181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 145/288] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:47.113474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:47.123185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:47.230060 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:47.290192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb76a-852d-473d-ad85-894647109685 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:47.326336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee5bd2-15b9-4794-b3a8-6f9cabeaee99 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:47.351683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:47.353709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:47.354223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:47.354727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:47.357006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:47.359871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:47.363687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 144/289] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:47 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:47.375352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:47.388724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:47.389621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:47.389943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:47.390223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] PATH_INFO: `/v3/users/1256c92323804879932d6348fab65ef8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:47.394560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] RBAC: Authorizing `identity:get_user(user_id=1256c92323804879932d6348fab65ef8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:47.396077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:47.397846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 146/290] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:47 2022] GET /identity/v3/users/1256c92323804879932d6348fab65ef8 => generated 297 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:47.408036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:47.606261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:47.619830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2ae5-8733-4b31-b48b-522a85021051 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:47.623591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd85d1-43f3-4d2a-b341-b27e2b905dd8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:47.639777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:47.698509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:47.699243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:47.699927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:47.700210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:47.700487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:47.702064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:47.702345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:47.702622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112/users/e847986016314bf19e047dcd5926d8f8/roles/8298062094fc4491a06a7a486ebc3b42` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:47.707250 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] RBAC: Authorizing `identity:create_grant(project_id=59923365865346149b07f6c3fd58b112, user_id=e847986016314bf19e047dcd5926d8f8, role_id=8298062094fc4491a06a7a486ebc3b42)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:47.708760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:47.813615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:47.816431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:47.840019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 145/291] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:24:47 2022] PUT /identity/v3/projects/59923365865346149b07f6c3fd58b112/users/e847986016314bf19e047dcd5926d8f8/roles/8298062094fc4491a06a7a486ebc3b42 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:48.042258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 147/292] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:24:48.050170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:48.254292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5f88-40b2-4d88-94cf-f20341710330 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:48.329326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dd7aa-993a-4280-a3fe-fe28c463bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:48.330959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dd7aa-993a-4280-a3fe-fe28c463bdfd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:48.331455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dd7aa-993a-4280-a3fe-fe28c463bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:48.331944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dd7aa-993a-4280-a3fe-fe28c463bdfd None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:48.335435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dd7aa-993a-4280-a3fe-fe28c463bdfd None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:48.339058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dd7aa-993a-4280-a3fe-fe28c463bdfd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:48.342542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 146/293] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:48 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:48.353451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:48.371871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:48.612406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafd46-501c-4dd7-91b4-1ae7e9ce06d8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:48.672577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea403e-d8f1-4b25-8bde-e4523bf32bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:48.673261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea403e-d8f1-4b25-8bde-e4523bf32bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:48.673551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea403e-d8f1-4b25-8bde-e4523bf32bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:48.673883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea403e-d8f1-4b25-8bde-e4523bf32bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:48.674775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea403e-d8f1-4b25-8bde-e4523bf32bf2 None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=1256c92323804879932d6348fab65ef8) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:48.675089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea403e-d8f1-4b25-8bde-e4523bf32bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:48.676621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea403e-d8f1-4b25-8bde-e4523bf32bf2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:48.684473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 148/294] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:48 2022] GET /identity/v3/role_assignments?user.id=1256c92323804879932d6348fab65ef8&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:48.814427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586be76-318f-4874-8a03-271b056ea2d6 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:48.814932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586be76-318f-4874-8a03-271b056ea2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:48.815426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586be76-318f-4874-8a03-271b056ea2d6 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:48.818133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 147/295] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:48.825274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdb1b6-548b-43c4-9bff-3dddf83b7087 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:48.825871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdb1b6-548b-43c4-9bff-3dddf83b7087 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:48.826304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdb1b6-548b-43c4-9bff-3dddf83b7087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:48.850724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-dbfdb1b6-548b-43c4-9bff-3dddf83b7087 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:48.852788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dbfdb1b6-548b-43c4-9bff-3dddf83b7087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:48.956813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:48.965117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 149/296] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:48.993272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586be76-318f-4874-8a03-271b056ea2d6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:49.047276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:49.206260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586be76-318f-4874-8a03-271b056ea2d6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:49.280766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a009d21-5dd3-4a07-b1d4-5a1c32d70145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:49.282081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a009d21-5dd3-4a07-b1d4-5a1c32d70145 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:49.282583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a009d21-5dd3-4a07-b1d4-5a1c32d70145 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:49.283075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a009d21-5dd3-4a07-b1d4-5a1c32d70145 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:49.285187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a009d21-5dd3-4a07-b1d4-5a1c32d70145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:49.287934 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a009d21-5dd3-4a07-b1d4-5a1c32d70145 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:49.291521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 148/297] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:49.297026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdb1b6-548b-43c4-9bff-3dddf83b7087 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:49.427407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdb1b6-548b-43c4-9bff-3dddf83b7087 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:49.466956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:49.467642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:49.467972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:49.468212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] PATH_INFO: `/v3/groups` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:49.468908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:49.470430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:49.539117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed22910-8e12-4b8d-be55-0d14c9569541 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:49.539117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed22910-8e12-4b8d-be55-0d14c9569541 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:49.543209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed22910-8e12-4b8d-be55-0d14c9569541 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:49.546541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 149/298] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:49.548663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77385-f5af-4c3c-98ae-321619285bee None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:49.548870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77385-f5af-4c3c-98ae-321619285bee None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:49.549139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77385-f5af-4c3c-98ae-321619285bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:49.556355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 150/299] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Jul 18 08:24:49 2022] POST /identity/v3/groups => generated 229 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:24:49.568335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-eaf77385-f5af-4c3c-98ae-321619285bee None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:49.569697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eaf77385-f5af-4c3c-98ae-321619285bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:49.656952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 150/300] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:49.695611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:49.806239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:49.867215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd617b-ca93-4206-90be-867eb4ab1810 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:49.926279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b72c9-0539-4626-a1d4-5183a1c957c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:49.927117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b72c9-0539-4626-a1d4-5183a1c957c4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:49.927409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b72c9-0539-4626-a1d4-5183a1c957c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:49.927690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b72c9-0539-4626-a1d4-5183a1c957c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:49.941636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b72c9-0539-4626-a1d4-5183a1c957c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-1c9b72c9-0539-4626-a1d4-5183a1c957c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:49.950467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:49.952200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:49.954413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 151/301] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:49.960252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77385-f5af-4c3c-98ae-321619285bee None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:49.960617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf7233-1199-4b50-bf15-e375dbd456f7 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:49.962774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf7233-1199-4b50-bf15-e375dbd456f7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:49.963582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf7233-1199-4b50-bf15-e375dbd456f7 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:49.966418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 152/302] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:49.975621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92641ce-ff0f-4bc0-a6e6-d42146dbf4e5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:49.976753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92641ce-ff0f-4bc0-a6e6-d42146dbf4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:49.977525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92641ce-ff0f-4bc0-a6e6-d42146dbf4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:49.984419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:50.014522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d92641ce-ff0f-4bc0-a6e6-d42146dbf4e5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:50.015761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d92641ce-ff0f-4bc0-a6e6-d42146dbf4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:50.109808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 153/303] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:50.129286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77385-f5af-4c3c-98ae-321619285bee None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:50.147360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92641ce-ff0f-4bc0-a6e6-d42146dbf4e5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:50.170099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:50.171155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:50.171647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:50.172125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:50.173092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:50.173625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:50.175374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:50.185894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 151/304] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:50.197751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:50.229613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:50.365708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92641ce-ff0f-4bc0-a6e6-d42146dbf4e5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:50.391256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2351b-160a-4e97-a46e-52666300ab8c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:50.422338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:50.440983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:50.442921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:50.443860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:50.444442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:50.451842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:50.454347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:50.455484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:50.456182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] PATH_INFO: `/v3/users/4d2b462cbe7e489f9233281b6f80acd9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:50.468667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:50.485099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2b462cbe7e489f9233281b6f80acd9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:50.487850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:50.490090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:50.491914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 154/305] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:24:50.501053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:50.503308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:50.504678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 152/306] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:50 2022] GET /identity/v3/users/4d2b462cbe7e489f9233281b6f80acd9 => generated 293 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:50.514501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:50.731779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f60ac-bcd0-40bc-b8ff-9b6bf9741639 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:50.744868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68d06-1cd7-40ac-afe1-c9d49a124eec None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:50.770648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:50.800650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497248a-e3f9-4da0-b468-d2d8cbac3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:50.802385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497248a-e3f9-4da0-b468-d2d8cbac3e2f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:50.803266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497248a-e3f9-4da0-b468-d2d8cbac3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:50.804076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497248a-e3f9-4da0-b468-d2d8cbac3e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:50.807826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497248a-e3f9-4da0-b468-d2d8cbac3e2f None admin] RBAC: Adding query filter params (role.id=8298062094fc4491a06a7a486ebc3b42, user.id=4d2b462cbe7e489f9233281b6f80acd9, scope.system=all) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:50.808764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497248a-e3f9-4da0-b468-d2d8cbac3e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:50.813141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497248a-e3f9-4da0-b468-d2d8cbac3e2f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:50.821391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:50.829720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 153/307] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 08:24:50 2022] GET /identity/v3/role_assignments?user.id=4d2b462cbe7e489f9233281b6f80acd9&scope.system=all&role.id=8298062094fc4491a06a7a486ebc3b42 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:50.829994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:50.829994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:50.829994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:50.829994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:50.829994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:50.829994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:50.848801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 155/308] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:50.854642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0250-3b3f-419d-8d19-b6426bdcda21 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:50.854931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0250-3b3f-419d-8d19-b6426bdcda21 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:50.855219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0250-3b3f-419d-8d19-b6426bdcda21 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:50.856681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 154/309] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:50.858965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:50.862310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ad4b-a05a-494e-b75d-0a77d3e24ebc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:50.862704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ad4b-a05a-494e-b75d-0a77d3e24ebc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:50.862868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ad4b-a05a-494e-b75d-0a77d3e24ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:50.870434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:50.881912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fd90ad4b-a05a-494e-b75d-0a77d3e24ebc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:50.883695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fd90ad4b-a05a-494e-b75d-0a77d3e24ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:51.009242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6036e5-87b7-470f-8f98-0cd094b2cc9d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:51.015740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 155/310] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:51.054138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ad4b-a05a-494e-b75d-0a77d3e24ebc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:51.084048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:51.085559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:51.086661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:51.087140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] PATH_INFO: `/v3/users/62f80753c2704075b54d5e4397d7b4a4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:51.089579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] RBAC: Authorizing `identity:get_user(user_id=62f80753c2704075b54d5e4397d7b4a4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:51.092501 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:51.096747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 156/311] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:50 2022] GET /identity/v3/users/62f80753c2704075b54d5e4397d7b4a4 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:51.106882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:51.198764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:51.235634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ad4b-a05a-494e-b75d-0a77d3e24ebc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:51.287102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:51.288139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:51.288585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:51.289599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:51.292576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:51.303330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:51.312407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:51.313422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:51.314227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:51.316735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 156/312] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:51.323080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:51.345636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322750-ba85-47d8-9e07-6840d07c7d94 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:51.438092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:51.439491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:51.440008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:51.440528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] PATH_INFO: `/v3/system/users/62f80753c2704075b54d5e4397d7b4a4/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:51.443196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=62f80753c2704075b54d5e4397d7b4a4, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:51.446372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:51.496842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76483839-1434-4e74-b1e1-dd52ee3f6aee None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:51.566680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 157/313] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Jul 18 08:24:51 2022] PUT /identity/v3/system/users/62f80753c2704075b54d5e4397d7b4a4/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:24:51.571980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:51.573185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:51.573669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:51.574494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:51.575684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:51.576386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:51.578286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:51.592434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 157/314] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:24:51.600820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:51.778697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4b95-5a2b-43f4-b34a-c6abaf158777 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:51.781918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:51.825097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b0b41-4af5-45f0-97a0-28cee4aa6978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:51.827231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0b41-4af5-45f0-97a0-28cee4aa6978 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:51.827231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0b41-4af5-45f0-97a0-28cee4aa6978 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:51.827231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0b41-4af5-45f0-97a0-28cee4aa6978 None admin] PATH_INFO: `/v3/users/e847986016314bf19e047dcd5926d8f8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:51.827894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b0b41-4af5-45f0-97a0-28cee4aa6978 None admin] RBAC: Authorizing `identity:get_user(user_id=e847986016314bf19e047dcd5926d8f8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:51.829415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b0b41-4af5-45f0-97a0-28cee4aa6978 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:51.832731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 158/315] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:51 2022] GET /identity/v3/users/e847986016314bf19e047dcd5926d8f8 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:51.840374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:51.915217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:51.971473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa7b41-ebf5-4e0f-a6db-23456de5908c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:52.024041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:52.024902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:52.025192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:52.025475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:52.071078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0566c-519d-4aee-9e6a-1a41b7440315 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:52.071758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0566c-519d-4aee-9e6a-1a41b7440315 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:52.072239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0566c-519d-4aee-9e6a-1a41b7440315 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:52.074342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 159/316] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:52.079623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7fda-c9a9-4678-9f75-623ee6b778dc None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:52.079871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7fda-c9a9-4678-9f75-623ee6b778dc None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:52.080152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7fda-c9a9-4678-9f75-623ee6b778dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:52.109668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6bcf7fda-c9a9-4678-9f75-623ee6b778dc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:52.111851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6bcf7fda-c9a9-4678-9f75-623ee6b778dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:52.149401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:52.151531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:52.243590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 160/317] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:24:52.255996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:52.268489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7fda-c9a9-4678-9f75-623ee6b778dc None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:52.365909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 158/318] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:24:52.375162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:52.460409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7fda-c9a9-4678-9f75-623ee6b778dc None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:52.464020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:52.504432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8b40-4cbc-404b-a020-c7e4e153dfae None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:52.530520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:52.532574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:52.533377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:52.534148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:52.536840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:52.540223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:52.544302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 161/319] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:52.550991 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:52.565591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:52.567522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:52.568073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:52.568577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:52.571121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:52.574390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:52.577899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 159/320] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:52 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:52.591013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:52.670222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:52.775065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50634523-1b55-41b9-ba38-3cd9884cf3c7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:52.814621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4df24-fb3f-457d-95ed-be9c39cdef64 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:52.839542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a83a0-2a58-40a8-93fe-242948a4258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:52.841082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a83a0-2a58-40a8-93fe-242948a4258c None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:52.841932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a83a0-2a58-40a8-93fe-242948a4258c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:52.842679 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a83a0-2a58-40a8-93fe-242948a4258c None admin] PATH_INFO: `/v3/groups` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:52.844392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a83a0-2a58-40a8-93fe-242948a4258c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:52.847463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a83a0-2a58-40a8-93fe-242948a4258c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:52.876425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135ce64-1f34-492b-abae-4b2018727505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:52.877314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135ce64-1f34-492b-abae-4b2018727505 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:52.877773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135ce64-1f34-492b-abae-4b2018727505 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:52.878181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135ce64-1f34-492b-abae-4b2018727505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:52.879185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135ce64-1f34-492b-abae-4b2018727505 None admin] RBAC: Adding query filter params (role.id=8298062094fc4491a06a7a486ebc3b42, scope.project.id=59923365865346149b07f6c3fd58b112, user.id=e847986016314bf19e047dcd5926d8f8) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:52.879627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135ce64-1f34-492b-abae-4b2018727505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:52.881492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135ce64-1f34-492b-abae-4b2018727505 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:52.898182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 160/321] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:24:52 2022] GET /identity/v3/role_assignments?user.id=e847986016314bf19e047dcd5926d8f8&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=8298062094fc4491a06a7a486ebc3b42 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:52.951128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 162/322] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Jul 18 08:24:52 2022] POST /identity/v3/groups => generated 226 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:24:53.129935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586e54-c766-4801-b7b6-029dcb6f88ef None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:53.130406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586e54-c766-4801-b7b6-029dcb6f88ef None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:53.130580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586e54-c766-4801-b7b6-029dcb6f88ef None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:53.131932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 161/323] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:53.138466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc83c-d857-4eeb-821b-27547e8a7cd3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:53.138842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc83c-d857-4eeb-821b-27547e8a7cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:53.139005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc83c-d857-4eeb-821b-27547e8a7cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:53.158994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-88bfc83c-d857-4eeb-821b-27547e8a7cd3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:53.160225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-88bfc83c-d857-4eeb-821b-27547e8a7cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:53.195116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:53.264451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 163/324] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:53.300675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35586e54-c766-4801-b7b6-029dcb6f88ef None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:53.474665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:53.501774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35586e54-c766-4801-b7b6-029dcb6f88ef None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:53.576365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:53.577935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:53.578435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:53.578929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:53.600086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:53.618110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:53.619281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:24:53.620097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:53.625391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 162/325] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:53.630604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc83c-d857-4eeb-821b-27547e8a7cd3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:53.827846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc83c-d857-4eeb-821b-27547e8a7cd3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:53.897407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:53.899273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:53.899860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:53.900536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:53.902120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:53.902688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:53.905624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:53.927314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 164/326] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:53.936393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:54.080792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba186b7-9e1a-489c-b23d-6ce131e67c0d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:54.128879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faf19a-45f1-4c1f-9642-2c8c4f4587e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:54.130463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf19a-45f1-4c1f-9642-2c8c4f4587e6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:54.130961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf19a-45f1-4c1f-9642-2c8c4f4587e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:54.131461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf19a-45f1-4c1f-9642-2c8c4f4587e6 None admin] PATH_INFO: `/v3/users/4d2b462cbe7e489f9233281b6f80acd9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:54.137305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faf19a-45f1-4c1f-9642-2c8c4f4587e6 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2b462cbe7e489f9233281b6f80acd9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:54.140069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faf19a-45f1-4c1f-9642-2c8c4f4587e6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:54.143737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 163/327] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:53 2022] GET /identity/v3/users/4d2b462cbe7e489f9233281b6f80acd9 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:54.152447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:54.213589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:54.339616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2dc2a-17ab-412d-be46-0b7bd807b2ed None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:54.394345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff905a-d0fd-4555-9136-cccda7e7acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:54.395227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff905a-d0fd-4555-9136-cccda7e7acb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:54.395511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff905a-d0fd-4555-9136-cccda7e7acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:54.395789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff905a-d0fd-4555-9136-cccda7e7acb5 None admin] PATH_INFO: `/v3/system/users/4d2b462cbe7e489f9233281b6f80acd9/roles/8298062094fc4491a06a7a486ebc3b42` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:54.402715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff905a-d0fd-4555-9136-cccda7e7acb5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d2b462cbe7e489f9233281b6f80acd9, role_id=8298062094fc4491a06a7a486ebc3b42)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:54.404150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff905a-d0fd-4555-9136-cccda7e7acb5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:54.475657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 165/328] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Jul 18 08:24:54 2022] PUT /identity/v3/system/users/4d2b462cbe7e489f9233281b6f80acd9/roles/8298062094fc4491a06a7a486ebc3b42 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:24:54.623757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846aab7-a93e-4a41-8059-7f9d1a014908 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:54.624304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846aab7-a93e-4a41-8059-7f9d1a014908 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:54.624554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846aab7-a93e-4a41-8059-7f9d1a014908 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:54.626933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 164/329] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:54.633237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce0d21-f269-4c5b-90e2-9332db3768a2 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:54.634389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce0d21-f269-4c5b-90e2-9332db3768a2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:54.634947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce0d21-f269-4c5b-90e2-9332db3768a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:54.670180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a6ce0d21-f269-4c5b-90e2-9332db3768a2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:54.671417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a6ce0d21-f269-4c5b-90e2-9332db3768a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:54.764758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 166/330] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:54.797812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846aab7-a93e-4a41-8059-7f9d1a014908 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:54.846873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:55.059989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846aab7-a93e-4a41-8059-7f9d1a014908 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:55.131506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:55.133749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:55.134423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:55.135109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:55.164590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:55.181260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:55.183130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:55.184858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:55.191678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 165/331] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:55.198854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce0d21-f269-4c5b-90e2-9332db3768a2 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:55.221273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:55.335951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce0d21-f269-4c5b-90e2-9332db3768a2 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:55.393383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:55.394131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:55.394393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:55.394661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:55.395432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:55.395739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:55.397167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:55.408196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 167/332] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:55.415510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:55.609642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:55.658014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904265f-c284-41d5-8834-ff9c237a692c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:55.739239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c606f2-8e0b-4708-b661-634fcb1fab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:55.741003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c606f2-8e0b-4708-b661-634fcb1fab12 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:55.741507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c606f2-8e0b-4708-b661-634fcb1fab12 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:55.742564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c606f2-8e0b-4708-b661-634fcb1fab12 None admin] PATH_INFO: `/v3/users/62f80753c2704075b54d5e4397d7b4a4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:55.744953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c606f2-8e0b-4708-b661-634fcb1fab12 None admin] RBAC: Authorizing `identity:get_user(user_id=62f80753c2704075b54d5e4397d7b4a4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:55.747836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c606f2-8e0b-4708-b661-634fcb1fab12 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:55.751481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 166/333] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:24:55 2022] GET /identity/v3/users/62f80753c2704075b54d5e4397d7b4a4 => generated 293 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:55.757049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:55.926139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:55.954160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8e9f-954f-41cc-bbd3-860da5d7b916 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:56.000270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:56.000948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:56.001227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:56.001502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:56.001652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3abd-0bae-4c66-97c9-f94105837e5d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:56.002207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3abd-0bae-4c66-97c9-f94105837e5d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:56.002378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] RBAC: Adding query filter params (role.id=6364bdd7a64e476ba4944148f2453c0b, user.id=62f80753c2704075b54d5e4397d7b4a4, scope.system=all) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:56.002715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:56.002865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3abd-0bae-4c66-97c9-f94105837e5d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:56.004196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:56.005446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 167/334] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:56.016123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d25f7-f25f-459f-8016-4739644ac8ce None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:56.016606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d25f7-f25f-459f-8016-4739644ac8ce None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:56.017094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d25f7-f25f-459f-8016-4739644ac8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:56.022389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 168/335] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 08:24:55 2022] GET /identity/v3/role_assignments?user.id=62f80753c2704075b54d5e4397d7b4a4&scope.system=all&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 510 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:56.063733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2c7d25f7-f25f-459f-8016-4739644ac8ce None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:56.065707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2c7d25f7-f25f-459f-8016-4739644ac8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:56.168658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 168/336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:56.208268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:56.458515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f16e0-66fd-45ad-862c-e6b29ae02577 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:56.544178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:56.545491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:56.546028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:56.546526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:56.558225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:56.583639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:56.603312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:56.605090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:56.607113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 169/337] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:24:56.612542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d25f7-f25f-459f-8016-4739644ac8ce None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:56.775425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:56.804743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d25f7-f25f-459f-8016-4739644ac8ce None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:56.856503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1f460-4990-4f12-8436-6ec06cd19ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:56.857221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f460-4990-4f12-8436-6ec06cd19ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:56.857512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f460-4990-4f12-8436-6ec06cd19ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:56.857815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f460-4990-4f12-8436-6ec06cd19ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:56.858618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1f460-4990-4f12-8436-6ec06cd19ee4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:56.858929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1f460-4990-4f12-8436-6ec06cd19ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:56.860369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1f460-4990-4f12-8436-6ec06cd19ee4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:56.871996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 169/338] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:56.878351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:57.143906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ded1-e2e1-4537-9b0d-a27ebe5d0d5d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:57.217139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:57.217834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:57.218124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:57.218405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:57.355271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:57.372172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:57.375613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:57.464365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9205b-414a-4900-afec-11b2393c98a4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:57.464581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9205b-414a-4900-afec-11b2393c98a4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:57.464883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9205b-414a-4900-afec-11b2393c98a4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:57.466589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 170/339] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:57.476997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a19f0-291c-43b4-948f-8465e99f2b7e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:57.477459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a19f0-291c-43b4-948f-8465e99f2b7e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:57.477960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a19f0-291c-43b4-948f-8465e99f2b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:57.531422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8b3a19f0-291c-43b4-948f-8465e99f2b7e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:57.536268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8b3a19f0-291c-43b4-948f-8465e99f2b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:57.675495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 170/340] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:57.678166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:57.746434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 171/341] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:57.849181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a19f0-291c-43b4-948f-8465e99f2b7e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:57.859064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:57.865626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c788ed-53a0-47b7-a012-a88e053c8833 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:58.005385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:58.008290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:58.009136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:58.010230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:58.015634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:58.019280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:58.025843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 171/342] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:57 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:58.035852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:58.094631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:58.151742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a19f0-291c-43b4-948f-8465e99f2b7e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:58.318456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18813a-90a4-41cb-a3c2-eeb0b76b584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:58.321841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18813a-90a4-41cb-a3c2-eeb0b76b584a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:58.322970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18813a-90a4-41cb-a3c2-eeb0b76b584a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:58.328272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18813a-90a4-41cb-a3c2-eeb0b76b584a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:58.373794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18813a-90a4-41cb-a3c2-eeb0b76b584a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ff18813a-90a4-41cb-a3c2-eeb0b76b584a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:58.399680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:58.401478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:24:58.403131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:24:58.414925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 172/343] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 567 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:24:58.424674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7066c-c7d7-4a7a-9a82-bc84966c6a78 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:58.424674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7066c-c7d7-4a7a-9a82-bc84966c6a78 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:58.424674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7066c-c7d7-4a7a-9a82-bc84966c6a78 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:58.425386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 173/344] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:58.426243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7066c-c7d7-4a7a-9a82-bc84966c6a78 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:58.470119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67a584-9699-4226-b764-82b9702d1dc1 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:58.569778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7066c-c7d7-4a7a-9a82-bc84966c6a78 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:58.570410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fa171-4397-45a4-8c07-05f4e7796fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:58.571911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fa171-4397-45a4-8c07-05f4e7796fed None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:58.572401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fa171-4397-45a4-8c07-05f4e7796fed None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:58.572900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fa171-4397-45a4-8c07-05f4e7796fed None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:58.598919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fa171-4397-45a4-8c07-05f4e7796fed None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:58.602332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fa171-4397-45a4-8c07-05f4e7796fed None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:58.606084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 172/345] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:24:58 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:58.606689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:58.615958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552912-8866-4f61-84d9-c3854726d1ff None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:58.616431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552912-8866-4f61-84d9-c3854726d1ff None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:58.617513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552912-8866-4f61-84d9-c3854726d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:58.620926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:58.621622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:58.621955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:58.624754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:58.624754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:58.624754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:58.624754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:58.635776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 174/346] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:58.636649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:58.680076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-68552912-8866-4f61-84d9-c3854726d1ff None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:58.682189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-68552912-8866-4f61-84d9-c3854726d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:58.753227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:58.759273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea4a24-2e4a-4840-be80-dd00445bc869 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:58.804827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:58.806316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:58.807015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:58.807445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:58.808463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=d7a67e36889844dca6d15883832f5e91) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:58.808954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:58.811327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:58.818244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 175/347] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:24:58 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:58.822894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:58.889795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 173/348] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:58.913256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:58.973275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68552912-8866-4f61-84d9-c3854726d1ff None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:58.985817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93f82-c728-485f-90c3-5a218fe6477a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:59.032442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df47b1d-a246-4d17-8f2e-1995d6e4cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:59.033164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df47b1d-a246-4d17-8f2e-1995d6e4cc38 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.033436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df47b1d-a246-4d17-8f2e-1995d6e4cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.033737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df47b1d-a246-4d17-8f2e-1995d6e4cc38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.115732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df47b1d-a246-4d17-8f2e-1995d6e4cc38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:59.118345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df47b1d-a246-4d17-8f2e-1995d6e4cc38 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:59.181442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:59.236892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 176/349] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:24:59.238723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9afb7-20b5-494e-b473-00a03d7782c7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.239164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9afb7-20b5-494e-b473-00a03d7782c7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.239921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9afb7-20b5-494e-b473-00a03d7782c7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.242201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 177/350] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:59.243700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9afb7-20b5-494e-b473-00a03d7782c7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:59.359043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68552912-8866-4f61-84d9-c3854726d1ff None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:59.365382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9afb7-20b5-494e-b473-00a03d7782c7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:59.413488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1d0c1-d641-4601-94fc-aeb890bc89df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:59.415651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1d0c1-d641-4601-94fc-aeb890bc89df None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.415940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1d0c1-d641-4601-94fc-aeb890bc89df None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.416487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1d0c1-d641-4601-94fc-aeb890bc89df None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.419185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1d0c1-d641-4601-94fc-aeb890bc89df None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:59.421662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1d0c1-d641-4601-94fc-aeb890bc89df None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:59.431823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 178/351] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:24:59 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:59.431823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fd5d5-d57f-4e61-b38a-c2bd2afc5471 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.431823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fd5d5-d57f-4e61-b38a-c2bd2afc5471 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.431823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fd5d5-d57f-4e61-b38a-c2bd2afc5471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.448263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:59.449092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.449376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.449651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.451717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b71fd5d5-d57f-4e61-b38a-c2bd2afc5471 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:24:59.453198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b71fd5d5-d57f-4e61-b38a-c2bd2afc5471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:24:59.474297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:24:59.487925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:24:59.488206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:24:59.489292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:24:59.490620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:24:59.494210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 174/352] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 522 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:24:59.496767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:59.532996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:59.563729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 179/353] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:24:59.564960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fd5d5-d57f-4e61-b38a-c2bd2afc5471 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:59.641480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ea54-4866-4f61-8443-97b7a14f732f None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:59.686807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fd5d5-d57f-4e61-b38a-c2bd2afc5471 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:59.687795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777fe97-2714-485e-8986-f55592e0a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:59.690621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fe97-2714-485e-8986-f55592e0a720 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.690621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fe97-2714-485e-8986-f55592e0a720 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.690621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fe97-2714-485e-8986-f55592e0a720 None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.693204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777fe97-2714-485e-8986-f55592e0a720 None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:59.693332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777fe97-2714-485e-8986-f55592e0a720 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:59.695543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 175/354] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:24:59 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:59.696888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0c15-403b-496f-ab23-cfe9dc5e92b7 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.697412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0c15-403b-496f-ab23-cfe9dc5e92b7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.697945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0c15-403b-496f-ab23-cfe9dc5e92b7 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.699830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 176/355] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:59.701069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0c15-403b-496f-ab23-cfe9dc5e92b7 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:59.748184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfabfcd-1b85-4792-beca-60c13be77e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:24:59.749336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabfcd-1b85-4792-beca-60c13be77e64 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.749909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabfcd-1b85-4792-beca-60c13be77e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.750451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabfcd-1b85-4792-beca-60c13be77e64 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.752103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfabfcd-1b85-4792-beca-60c13be77e64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:24:59.752400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfabfcd-1b85-4792-beca-60c13be77e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:24:59.755050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfabfcd-1b85-4792-beca-60c13be77e64 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:24:59.779257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 180/356] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:24:59.780864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5ac04-e290-4246-902d-3f27b95b347c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:24:59.781349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5ac04-e290-4246-902d-3f27b95b347c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:24:59.781874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5ac04-e290-4246-902d-3f27b95b347c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:24:59.787911 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 181/357] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:24:59.789885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5ac04-e290-4246-902d-3f27b95b347c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:24:59.810219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:59.892404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:24:59.925223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0c15-403b-496f-ab23-cfe9dc5e92b7 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:24:59.971321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5ac04-e290-4246-902d-3f27b95b347c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:00.001827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2907c-e689-46b5-8fe8-63efe8c583b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:00.003468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2907c-e689-46b5-8fe8-63efe8c583b7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.004097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2907c-e689-46b5-8fe8-63efe8c583b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.004786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2907c-e689-46b5-8fe8-63efe8c583b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.024102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2907c-e689-46b5-8fe8-63efe8c583b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-aae2907c-e689-46b5-8fe8-63efe8c583b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:00.032404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:00.034176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 177/358] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:00.035420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b248-941c-49ff-ae9b-7e805e2e3a29 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.036661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b248-941c-49ff-ae9b-7e805e2e3a29 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.036661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b248-941c-49ff-ae9b-7e805e2e3a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.057899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:00.058360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0157b248-941c-49ff-ae9b-7e805e2e3a29 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:00.059587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.059784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0157b248-941c-49ff-ae9b-7e805e2e3a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:00.060149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.060581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.062290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=d7a67e36889844dca6d15883832f5e91) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:00.063764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:00.065791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:00.079506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 182/359] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:24:59 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=fb047c0afbd247f98f75175d913fed8e => generated 260 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:00.081838 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:00.149742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 178/360] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:00.149742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340aca-e28c-42ab-af48-f007dc3f6be0 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.149742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340aca-e28c-42ab-af48-f007dc3f6be0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.149742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340aca-e28c-42ab-af48-f007dc3f6be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.169790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6d340aca-e28c-42ab-af48-f007dc3f6be0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:00.169790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6d340aca-e28c-42ab-af48-f007dc3f6be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:00.253776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 179/361] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:00.254260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340aca-e28c-42ab-af48-f007dc3f6be0 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:00.263274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:00.307349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:00.367249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4be3f-8516-4071-9c2e-f736bda39a7e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:00.375734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340aca-e28c-42ab-af48-f007dc3f6be0 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:00.415524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:00.416216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.416487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.416753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.417538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:00.417887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:00.419557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:00.429588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 180/362] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:00.430504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:00.444355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:00.446777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.447589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.448588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.509265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:00.561272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e95c-c8ab-4526-8df5-f33618e97ff0 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:00.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:00.601706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.601706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.601706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.606544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:00.609811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:00.614820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:00.623926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:00.625995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 181/363] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:00.627784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:00.752589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867ec1d-8801-4a4d-8d4e-3bcc149c5cb5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:00.785711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:00.791594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:00.795695 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:00.796854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.797018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.810895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:00.811944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:00.820313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:00.822439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 182/364] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:00.824017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:00.852937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 183/365] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:00.854841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:00.952874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3cc20-0e29-4369-bcc4-c71934259475 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:00.996691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:00.997599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:00.997904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:00.998177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:01.056065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e73a-9404-4815-a4df-95e884762f1f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:01.064068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:01.079875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:01.081450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:01.116549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:01.117793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:01.118287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:01.118794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:01.120021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:01.120551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:01.122235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:01.132697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 184/366] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:01.134330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:01.182214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:01.205069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 183/367] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:01.205987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:01.259648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce84e43-7179-4048-b47f-2b2d9d5e1d4b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:01.311269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:01.312464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:01.313060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:01.313543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:01.314584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:01.315105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:01.316206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:01.318130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:01.331957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b1e95-5be2-4373-a0f4-b2bf6eea0018 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:01.333624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 185/368] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:25:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:01.334930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:01.410326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:01.411854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:01.412336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:01.412816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:01.416110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:01.418940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:01.422801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 184/369] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:01 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:01.424042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:01.565438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:01.569422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd49f-7231-4316-8373-d1ec001be56d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:01.654933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1a781-6601-4874-9908-c393c7cb7f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:01.656500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1a781-6601-4874-9908-c393c7cb7f78 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:01.656986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1a781-6601-4874-9908-c393c7cb7f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:01.657470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1a781-6601-4874-9908-c393c7cb7f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:01.662002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12ab9-1642-438d-928c-65e609c46227 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:01.751392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:01.751667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:01.752023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:01.752514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] PATH_INFO: `/v3/projects/ab95a2af933c40dba08b776a8568e994` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:01.758192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] RBAC: Authorizing `identity:get_project(project_id=ab95a2af933c40dba08b776a8568e994)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:01.760911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:01.764334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 185/370] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:01 2022] GET /identity/v3/projects/ab95a2af933c40dba08b776a8568e994 => generated 344 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:01.765851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:01.821011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:01.833118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1a781-6601-4874-9908-c393c7cb7f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:01.837340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1a781-6601-4874-9908-c393c7cb7f78 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:01.954575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c002-0417-427f-b132-d79b23e7e337 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:02.005068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:02.006045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.006330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.006609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] PATH_INFO: `/v3/users/4d2b462cbe7e489f9233281b6f80acd9` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.008037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] RBAC: Authorizing `identity:get_user(user_id=4d2b462cbe7e489f9233281b6f80acd9)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:02.009575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:02.012330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 186/371] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:25:01 2022] GET /identity/v3/users/4d2b462cbe7e489f9233281b6f80acd9 => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:02.012661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:02.061024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:02.068909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 186/372] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:02.071884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9c90-ddda-45a3-96aa-60c8317747bd None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.072290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9c90-ddda-45a3-96aa-60c8317747bd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.072771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9c90-ddda-45a3-96aa-60c8317747bd None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.077535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 187/373] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:02.082376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9c90-ddda-45a3-96aa-60c8317747bd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:02.181152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:02.199615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c9d9-61d4-4910-be41-77a5e4b71d7c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:02.275589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:02.277504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.278661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.279458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.282152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:02.284700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:02.286645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9c90-ddda-45a3-96aa-60c8317747bd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:02.293271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 187/374] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:02 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:02.293530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:02.371307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:02.372783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.373074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.373359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] PATH_INFO: `/v3/groups/22ffb1807b304c9ba072604785a5f3e5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.381441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] RBAC: Authorizing `identity:get_group(group_id=22ffb1807b304c9ba072604785a5f3e5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:02.385092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:02.385635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 188/375] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:02 2022] GET /identity/v3/groups/22ffb1807b304c9ba072604785a5f3e5 => generated 229 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:02.386549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:02.490108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:02.515692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6142b8-8f59-40e0-a1d9-891080197a4b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:02.567789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4686-49ec-486c-bb0c-295d7739c660 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:02.607910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865df0-4bb3-4276-b692-fbe5e0698ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:02.608961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865df0-4bb3-4276-b692-fbe5e0698ffa None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.609415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865df0-4bb3-4276-b692-fbe5e0698ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.609917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865df0-4bb3-4276-b692-fbe5e0698ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.611607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865df0-4bb3-4276-b692-fbe5e0698ffa None admin] RBAC: Adding query filter params (role.id=8298062094fc4491a06a7a486ebc3b42, user.id=4d2b462cbe7e489f9233281b6f80acd9, scope.system=all) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:02.612194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865df0-4bb3-4276-b692-fbe5e0698ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:02.615050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865df0-4bb3-4276-b692-fbe5e0698ffa None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:02.630929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:02.633167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.634014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.634560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.636019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:02.637209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 188/376] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 08:25:02 2022] GET /identity/v3/role_assignments?user.id=4d2b462cbe7e489f9233281b6f80acd9&scope.system=all&role.id=8298062094fc4491a06a7a486ebc3b42 => generated 510 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:02.638061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:02.638963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af1fc-fb95-453d-a017-381aaa074b17 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.639435 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af1fc-fb95-453d-a017-381aaa074b17 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.639904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af1fc-fb95-453d-a017-381aaa074b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.641657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 189/377] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:02 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:02.643162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:02.661161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-960af1fc-fb95-453d-a017-381aaa074b17 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:02.664052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-960af1fc-fb95-453d-a017-381aaa074b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:02.680037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:02.795192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 189/378] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:02.797648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af1fc-fb95-453d-a017-381aaa074b17 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:02.857942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac3e29-f489-46d8-aa5c-c80a0142a6a5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:02.919613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:02.929441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:02.933265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:02.933265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:02.933265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:02.933265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=59923365865346149b07f6c3fd58b112) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:02.933265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:02.935795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:02.948037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 190/379] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:02 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:02.951522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:02.998338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af1fc-fb95-453d-a017-381aaa074b17 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:03.065945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:03.066640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.066923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.067332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:03.068065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] RBAC: Adding query filter params (group.id=22ffb1807b304c9ba072604785a5f3e5, role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=ab95a2af933c40dba08b776a8568e994) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:03.068375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:03.070335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:03.077142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 190/380] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:02 2022] GET /identity/v3/role_assignments?group.id=22ffb1807b304c9ba072604785a5f3e5&scope.project.id=ab95a2af933c40dba08b776a8568e994&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:03.077970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:03.124216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55820f-55ed-4164-b353-1a85ed2ae75e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:03.166165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:03.172815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b2add-d0a7-4759-acd2-49c2dce64f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:03.174139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b2add-d0a7-4759-acd2-49c2dce64f9c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.174664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b2add-d0a7-4759-acd2-49c2dce64f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.175713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b2add-d0a7-4759-acd2-49c2dce64f9c None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:03.177922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b2add-d0a7-4759-acd2-49c2dce64f9c None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:03.181226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b2add-d0a7-4759-acd2-49c2dce64f9c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:03.183987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 191/381] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:02 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:03.186240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791bddb-6776-4207-9c04-44bf5e4d6493 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.186759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791bddb-6776-4207-9c04-44bf5e4d6493 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.187215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791bddb-6776-4207-9c04-44bf5e4d6493 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:03.189510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 192/382] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:03.196424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791bddb-6776-4207-9c04-44bf5e4d6493 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:03.302709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:03.313066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f2ee-a4bb-42bb-b70f-4b0f9e0f0a16 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:03.359134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a8f5-5224-48fa-a688-3fe98ab61c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:03.359949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a8f5-5224-48fa-a688-3fe98ab61c8b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.360240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a8f5-5224-48fa-a688-3fe98ab61c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.360524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a8f5-5224-48fa-a688-3fe98ab61c8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:03.374269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a8f5-5224-48fa-a688-3fe98ab61c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-90d1a8f5-5224-48fa-a688-3fe98ab61c8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:03.383444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:03.384506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:03.385889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 191/383] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:03.387154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439697f-8196-4554-896e-fa4e83b10018 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.387154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439697f-8196-4554-896e-fa4e83b10018 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.387154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439697f-8196-4554-896e-fa4e83b10018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:03.394987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791bddb-6776-4207-9c04-44bf5e4d6493 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:03.412111 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-9439697f-8196-4554-896e-fa4e83b10018 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:03.414183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9439697f-8196-4554-896e-fa4e83b10018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:03.469997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:03.471374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.471830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.472338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:03.474942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=59923365865346149b07f6c3fd58b112) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:03.476483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:03.480495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:03.495164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 193/384] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:03 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=fb047c0afbd247f98f75175d913fed8e => generated 260 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:03.496620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:03.574272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 192/385] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:03.613090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439697f-8196-4554-896e-fa4e83b10018 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:03.628589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:03.739537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae37c0d-b3a2-41e9-8733-7256011ff498 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:03.784296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:03.798491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:03.802264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.802264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.802264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:03.802264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:03.802264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:03.802264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:03.814949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 194/386] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:03.828281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:03.841802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439697f-8196-4554-896e-fa4e83b10018 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:03.974934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:03.977026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:03.977835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:03.978078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:04.015604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:04.040150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:04.041878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:04.043394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:04.051604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 193/387] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:25:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:04.061857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:04.065116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ea491-5233-4785-8bd0-b5bf2d6df8fc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:04.160220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:04.165765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:04.167102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:04.170426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:04.176930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:04.181236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:04.186000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 195/388] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:03 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:04.203255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:04.289033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:04.381294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:04.437364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e5775-002a-4ac4-aa97-eb4f1dfbf32b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:04.493716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2850e-5d06-47ac-a98f-ef84f99acf6e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:04.543179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:04.544226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:04.544738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:04.545228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:04.546714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:04.547285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:04.553740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:04.574555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 194/389] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:04.581706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:04.647131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:04.648710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:04.648994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:04.649273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:04.654571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:04.656070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:04.658275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 196/390] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:04 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:04.671090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:04.769328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7add-1a1b-4d0a-846e-d3bd3a3fedde None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:04.812690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:04.833123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:04.835627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:04.836468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:04.837205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:04.840248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:04.843700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:04.847744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 195/391] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:04 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:04.855123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:05.014071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ce30a-54e8-4961-8758-3af27b65dd56 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:05.080572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:05.100960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ea415-04c6-4f93-93c7-725445f3d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:05.103485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea415-04c6-4f93-93c7-725445f3d574 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:05.104257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea415-04c6-4f93-93c7-725445f3d574 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:05.104967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea415-04c6-4f93-93c7-725445f3d574 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91/groups/dc4dde0350124cb3829106bf227905e4/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:05.108698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ea415-04c6-4f93-93c7-725445f3d574 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a67e36889844dca6d15883832f5e91, group_id=dc4dde0350124cb3829106bf227905e4, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:05.111648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ea415-04c6-4f93-93c7-725445f3d574 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:05.138271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e971f95-f6ae-4a52-978e-4dcd2e300aac None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:05.177989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:05.179581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:05.179927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:05.180057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:05.181313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:05.182820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:05.188666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 196/392] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:04 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:05.193799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:05.206987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 197/393] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 08:25:04 2022] PUT /identity/v3/projects/d7a67e36889844dca6d15883832f5e91/groups/dc4dde0350124cb3829106bf227905e4/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:05.275794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:05.328078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03765f2a-4001-4a87-862c-5864f44207a5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:05.370303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e850a8-b691-48a0-a5a0-abc6b38f705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:05.371524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e850a8-b691-48a0-a5a0-abc6b38f705e None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:05.371959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e850a8-b691-48a0-a5a0-abc6b38f705e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:05.372396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e850a8-b691-48a0-a5a0-abc6b38f705e None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91/groups/dc4dde0350124cb3829106bf227905e4/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:05.375019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e850a8-b691-48a0-a5a0-abc6b38f705e None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a67e36889844dca6d15883832f5e91, group_id=dc4dde0350124cb3829106bf227905e4, role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:05.376704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e850a8-b691-48a0-a5a0-abc6b38f705e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:05.447415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 197/394] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 08:25:05 2022] PUT /identity/v3/projects/d7a67e36889844dca6d15883832f5e91/groups/dc4dde0350124cb3829106bf227905e4/roles/fb047c0afbd247f98f75175d913fed8e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:25:05.699727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837fc44-b9a4-4b00-a511-9112d9988fce None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:05.699960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837fc44-b9a4-4b00-a511-9112d9988fce None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:05.700310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837fc44-b9a4-4b00-a511-9112d9988fce None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:05.701961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 198/395] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:05.711351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99857-b956-45fe-8fcf-5f2538ff70ab None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:05.712887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99857-b956-45fe-8fcf-5f2538ff70ab None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:05.713646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99857-b956-45fe-8fcf-5f2538ff70ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:05.746327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3cd99857-b956-45fe-8fcf-5f2538ff70ab None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:05.747571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3cd99857-b956-45fe-8fcf-5f2538ff70ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:05.848349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 198/396] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:05.926250 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837fc44-b9a4-4b00-a511-9112d9988fce None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:06.083030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837fc44-b9a4-4b00-a511-9112d9988fce None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:06.136334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:06.137150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:06.137438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:06.137738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:06.157662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:06.166746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:06.168486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:06.170640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 199/397] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:06.182648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99857-b956-45fe-8fcf-5f2538ff70ab None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:06.255005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:06.390900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99857-b956-45fe-8fcf-5f2538ff70ab None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:06.483065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da4152-1342-43ce-b385-cc33e045255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:06.484188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da4152-1342-43ce-b385-cc33e045255e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:06.484687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da4152-1342-43ce-b385-cc33e045255e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:06.485186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da4152-1342-43ce-b385-cc33e045255e None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:06.486662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da4152-1342-43ce-b385-cc33e045255e None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:06.487198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da4152-1342-43ce-b385-cc33e045255e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:06.489996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da4152-1342-43ce-b385-cc33e045255e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:06.517868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 199/398] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:06.539616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:06.644112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:06.653149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fb85-9f41-4a0a-a8eb-a3c1f47ea2ac None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:06.653609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fb85-9f41-4a0a-a8eb-a3c1f47ea2ac None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:06.654132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fb85-9f41-4a0a-a8eb-a3c1f47ea2ac None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:06.657781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 200/399] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:25:06.667326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a8c3-52d2-49db-9612-a1d1874cd2d5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:06.667822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a8c3-52d2-49db-9612-a1d1874cd2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:06.668310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a8c3-52d2-49db-9612-a1d1874cd2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:06.707306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0833a8c3-52d2-49db-9612-a1d1874cd2d5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:06.709344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0833a8c3-52d2-49db-9612-a1d1874cd2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:06.750099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819b433-8805-4d1f-974f-e29298231a94 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:06.854379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 201/400] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:06.875827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:06.877625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:06.878344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:06.879075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:06.887224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:06.890360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:06.894042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 200/401] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:06 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:06.902660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833a8c3-52d2-49db-9612-a1d1874cd2d5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:06.916816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:06.973324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:07.107475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833a8c3-52d2-49db-9612-a1d1874cd2d5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:07.183264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:07.184734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:07.185231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:07.185733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:07.195534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:07.198569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:07.202035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 202/402] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:06 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:07.211111 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:07.219552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab46a5-0dfa-4861-a71c-4405d4e4537b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:07.284777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251c99f-67a2-4728-846b-20b35f85acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:07.286939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c99f-67a2-4728-846b-20b35f85acf8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:07.287741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c99f-67a2-4728-846b-20b35f85acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:07.289086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c99f-67a2-4728-846b-20b35f85acf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:07.294271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:07.311471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251c99f-67a2-4728-846b-20b35f85acf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4251c99f-67a2-4728-846b-20b35f85acf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:07.327041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:07.329052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:07.330919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:07.341732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 201/403] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:07.341732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b8d2-02b1-4748-805d-702407977eeb None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:07.341732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b8d2-02b1-4748-805d-702407977eeb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:07.341732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b8d2-02b1-4748-805d-702407977eeb None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:07.348715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 202/404] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:07.351503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721b8d2-02b1-4748-805d-702407977eeb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:07.469660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c90f-7e3a-48a2-ac28-504c32e0688e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:07.492410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:07.534773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721b8d2-02b1-4748-805d-702407977eeb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:07.558843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:07.560728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:07.561444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:07.562372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112/groups/dc4dde0350124cb3829106bf227905e4/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:07.566620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] RBAC: Authorizing `identity:create_grant(project_id=59923365865346149b07f6c3fd58b112, group_id=dc4dde0350124cb3829106bf227905e4, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:07.570108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:07.601534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838997b6-2ee7-4245-93c9-5caace5efeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:07.603437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838997b6-2ee7-4245-93c9-5caace5efeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:07.604078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838997b6-2ee7-4245-93c9-5caace5efeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:07.604654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838997b6-2ee7-4245-93c9-5caace5efeb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:07.606279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838997b6-2ee7-4245-93c9-5caace5efeb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:07.606910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838997b6-2ee7-4245-93c9-5caace5efeb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:07.609784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838997b6-2ee7-4245-93c9-5caace5efeb5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:07.627188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 203/405] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:07.629228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5034-ca16-4c01-be5a-29f7925c411c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:07.630604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5034-ca16-4c01-be5a-29f7925c411c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:07.631452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5034-ca16-4c01-be5a-29f7925c411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:07.666506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-451c5034-ca16-4c01-be5a-29f7925c411c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:07.668593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-451c5034-ca16-4c01-be5a-29f7925c411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:07.685157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 203/406] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 08:25:07 2022] PUT /identity/v3/projects/59923365865346149b07f6c3fd58b112/groups/dc4dde0350124cb3829106bf227905e4/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:07.691665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:07.737295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:07.861492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 204/407] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:07.919369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5034-ca16-4c01-be5a-29f7925c411c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:07.921587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458717-fc7a-401d-8039-ea1a1791fc83 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:08.010292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:08.011778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.012347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.012855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] PATH_INFO: `/v3/groups/22ffb1807b304c9ba072604785a5f3e5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.015591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] RBAC: Authorizing `identity:get_group(group_id=22ffb1807b304c9ba072604785a5f3e5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:08.018560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:08.023729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 204/408] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:07 2022] GET /identity/v3/groups/22ffb1807b304c9ba072604785a5f3e5 => generated 229 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:08.032959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:08.076977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5034-ca16-4c01-be5a-29f7925c411c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:08.082325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:08.182620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:08.184484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.185259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.186079 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.225091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:08.242823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:08.244588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:08.246165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:08.250940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 205/409] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:08.262389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:08.262618 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae24646-3d90-46b9-a1e1-4864e32ce461 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:08.314783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:08.332893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb292df-6b10-49ef-bb7c-31a0412f2f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:08.336269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb292df-6b10-49ef-bb7c-31a0412f2f53 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.337109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb292df-6b10-49ef-bb7c-31a0412f2f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.338079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb292df-6b10-49ef-bb7c-31a0412f2f53 None admin] PATH_INFO: `/v3/projects/ab95a2af933c40dba08b776a8568e994` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.342376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb292df-6b10-49ef-bb7c-31a0412f2f53 None admin] RBAC: Authorizing `identity:get_project(project_id=ab95a2af933c40dba08b776a8568e994)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:08.347159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb292df-6b10-49ef-bb7c-31a0412f2f53 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:08.358171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 205/410] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:08 2022] GET /identity/v3/projects/ab95a2af933c40dba08b776a8568e994 => generated 344 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:08.363046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489897b-7543-4b43-94f6-13c82d3bc1da None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.363365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489897b-7543-4b43-94f6-13c82d3bc1da None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.363868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489897b-7543-4b43-94f6-13c82d3bc1da None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.373856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 206/411] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:08.375458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489897b-7543-4b43-94f6-13c82d3bc1da None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:08.430678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c199f0-eff0-485b-b592-c7aca91ffd2a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:08.510742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f1d0-2aa5-4404-8bc1-c22148f4d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:08.511924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f1d0-2aa5-4404-8bc1-c22148f4d898 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.512464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f1d0-2aa5-4404-8bc1-c22148f4d898 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.512901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f1d0-2aa5-4404-8bc1-c22148f4d898 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.514381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f1d0-2aa5-4404-8bc1-c22148f4d898 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:08.514948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f1d0-2aa5-4404-8bc1-c22148f4d898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:08.517631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f1d0-2aa5-4404-8bc1-c22148f4d898 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:08.531593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489897b-7543-4b43-94f6-13c82d3bc1da None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:08.542818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 206/412] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:08.542818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75d71-d6c2-4f7b-b316-52dc8674b614 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.542818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75d71-d6c2-4f7b-b316-52dc8674b614 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.542818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75d71-d6c2-4f7b-b316-52dc8674b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.555077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:08.573736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f2c75d71-d6c2-4f7b-b316-52dc8674b614 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:08.575558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f2c75d71-d6c2-4f7b-b316-52dc8674b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:08.587556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875be80-59da-4b69-baef-ad58347ca048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:08.589327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875be80-59da-4b69-baef-ad58347ca048 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.590019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875be80-59da-4b69-baef-ad58347ca048 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.590791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875be80-59da-4b69-baef-ad58347ca048 None admin] PATH_INFO: `/v3/projects/ab95a2af933c40dba08b776a8568e994/groups/22ffb1807b304c9ba072604785a5f3e5/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.595755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875be80-59da-4b69-baef-ad58347ca048 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab95a2af933c40dba08b776a8568e994, group_id=22ffb1807b304c9ba072604785a5f3e5, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:08.598803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875be80-59da-4b69-baef-ad58347ca048 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:08.665239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 207/413] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:08.667679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12a1a-7e09-41c8-a5bd-1a941863b5bd None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.668324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12a1a-7e09-41c8-a5bd-1a941863b5bd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.668721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12a1a-7e09-41c8-a5bd-1a941863b5bd None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.676961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 208/414] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:08.676961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e12a1a-7e09-41c8-a5bd-1a941863b5bd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:08.687908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 207/415] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 08:25:08 2022] PUT /identity/v3/projects/ab95a2af933c40dba08b776a8568e994/groups/22ffb1807b304c9ba072604785a5f3e5/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:08.690025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455560-30ab-47e6-8359-0a1e6aaffc5d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:08.690574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455560-30ab-47e6-8359-0a1e6aaffc5d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:08.691117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455560-30ab-47e6-8359-0a1e6aaffc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:08.714896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:08.724216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-52455560-30ab-47e6-8359-0a1e6aaffc5d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:08.727253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-52455560-30ab-47e6-8359-0a1e6aaffc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:08.888724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 208/416] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:08.894639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455560-30ab-47e6-8359-0a1e6aaffc5d None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:08.957798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e12a1a-7e09-41c8-a5bd-1a941863b5bd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:09.029201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:09.030193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:09.030468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:09.030739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:09.032130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:09.033851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:09.041864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 209/417] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:08 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:09.041864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:09.123832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:09.134591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455560-30ab-47e6-8359-0a1e6aaffc5d None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:09.220615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:09.223282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:09.226171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:09.226171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:09.257713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:09.274289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:09.276106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:09.277597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:09.287053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 209/418] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:25:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:09.287404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:09.287638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:09.317445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145e5b-20d3-4bc2-9003-991200f69687 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:09.362442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:09.363586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:09.364265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:09.364677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:09.392845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:09.412183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:09.415018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:09.416586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:09.427239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 210/419] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:09.429738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:09.504562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c85e-1bfd-46af-8230-ca647b3b9fc0 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:09.582005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:09.583309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:09.583781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:09.584334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:09.587147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:09.590483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:09.594248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 210/420] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:09 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:09.596138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:09.639629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54fa73-d459-4560-80a3-7a3bbec96ada None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:09.650289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:09.706855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:09.709056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:09.710561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:09.711336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:09.712951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:09.713951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:09.716872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:09.734426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 211/421] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:09.735793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:09.751756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:09.808599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f307-588a-464b-a629-afd9e6de9049 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:09.878947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79991-b9a9-4b15-8498-1f46cc23c538 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:09.880386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:09.882676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:09.883590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:09.884413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:09.886238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:09.887097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:09.890071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:09.904364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 211/422] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:09.911481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:09.939510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:09.941015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:09.941672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:09.942272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112/groups/dc4dde0350124cb3829106bf227905e4/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:09.946162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] RBAC: Authorizing `identity:create_grant(project_id=59923365865346149b07f6c3fd58b112, group_id=dc4dde0350124cb3829106bf227905e4, role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:09.948305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:10.049259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 212/423] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 08:25:09 2022] PUT /identity/v3/projects/59923365865346149b07f6c3fd58b112/groups/dc4dde0350124cb3829106bf227905e4/roles/fb047c0afbd247f98f75175d913fed8e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:10.050582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:10.090066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:10.138140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da8b26-7fc2-47f3-b7c3-69fb5ed20a15 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:10.217268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:10.255577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364314df-71c3-4735-9858-eec8d8eb4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:10.256272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364314df-71c3-4735-9858-eec8d8eb4253 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:10.257208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364314df-71c3-4735-9858-eec8d8eb4253 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:10.257728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364314df-71c3-4735-9858-eec8d8eb4253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:10.294067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551dd2c-6b43-491d-9fc6-13ce815b033d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:10.361750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364314df-71c3-4735-9858-eec8d8eb4253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:10.363219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364314df-71c3-4735-9858-eec8d8eb4253 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:10.385891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd47dfa-a1d8-4aba-bdda-47b6710c1c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:10.387421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd47dfa-a1d8-4aba-bdda-47b6710c1c5b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:10.388178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd47dfa-a1d8-4aba-bdda-47b6710c1c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:10.388901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd47dfa-a1d8-4aba-bdda-47b6710c1c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:10.536221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:10.545205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd47dfa-a1d8-4aba-bdda-47b6710c1c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:10.548328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd47dfa-a1d8-4aba-bdda-47b6710c1c5b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:10.554412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 212/424] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:10.555945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a2ab-6703-4356-a836-173346b941a6 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:10.556239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a2ab-6703-4356-a836-173346b941a6 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:10.556525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a2ab-6703-4356-a836-173346b941a6 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:10.561810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 213/425] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:10.564097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151a2ab-6703-4356-a836-173346b941a6 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:10.627787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:10.683034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 213/426] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:10.684944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5657696-7ccb-4d70-9ee2-ef768b400fcd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:10.685183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5657696-7ccb-4d70-9ee2-ef768b400fcd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:10.685468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5657696-7ccb-4d70-9ee2-ef768b400fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:10.707442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b5657696-7ccb-4d70-9ee2-ef768b400fcd None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:10.709318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b5657696-7ccb-4d70-9ee2-ef768b400fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:10.748115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151a2ab-6703-4356-a836-173346b941a6 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:10.791588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:10.792496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:10.792759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:10.793037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:10.794497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:10.796083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:10.800251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 214/428] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:10.801349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5657696-7ccb-4d70-9ee2-ef768b400fcd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:10.802795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 214/428] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:10 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:10.811167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:10.894117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:10.919004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:10.923165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5657696-7ccb-4d70-9ee2-ef768b400fcd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:10.944382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312369ed-278f-405a-9eb4-b855b090e987 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:10.965281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:10.966475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:10.966923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:10.967943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] PATH_INFO: `/v3/projects/d7a67e36889844dca6d15883832f5e91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:10.969768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] RBAC: Authorizing `identity:get_project(project_id=d7a67e36889844dca6d15883832f5e91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:10.972155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:10.975526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 215/429] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:10 2022] GET /identity/v3/projects/d7a67e36889844dca6d15883832f5e91 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:10.977088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:10.985035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:10.986045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:10.986395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:10.986745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:10.988285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:10.990094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:10.997007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 215/430] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:10 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:10.998173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:11.122388 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9475e1-fc88-4d71-8116-b315b1f74847 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:11.136243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914efa7-8178-4aa0-a915-265ab78474b3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:11.165279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:11.167995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:11.169023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.169486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.169981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.179487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:11.181011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.181374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.181745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.183113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:11.184789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:11.184958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:11.187236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 216/431] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:10 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:11.188218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:11.199972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:11.201611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 08:25:11.203155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:11.209003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 216/432] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:11.211055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:11.247364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:11.338828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253927d8-09ca-4494-b47a-00cb8b1f0e7a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:11.347989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404962-b83a-48b8-8aad-ebd16d2e262c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:11.382158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa811b-9104-42be-b722-948856dc746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:11.383278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa811b-9104-42be-b722-948856dc746b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.383637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa811b-9104-42be-b722-948856dc746b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.383987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa811b-9104-42be-b722-948856dc746b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.384909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa811b-9104-42be-b722-948856dc746b None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=d7a67e36889844dca6d15883832f5e91) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:11.385401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa811b-9104-42be-b722-948856dc746b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:11.387081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa811b-9104-42be-b722-948856dc746b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:11.394621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 217/433] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:11 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:11.395757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa811b-9104-42be-b722-948856dc746b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:11.401112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:11.402189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.402659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.403113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.404226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=d7a67e36889844dca6d15883832f5e91) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:11.404735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:11.407282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:11.418645 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 217/434] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:11 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=d7a67e36889844dca6d15883832f5e91&role.id=fb047c0afbd247f98f75175d913fed8e => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:11.521402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:11.535270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa811b-9104-42be-b722-948856dc746b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:11.579274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958af12-d713-461a-8012-6a44a938a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:11.580003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958af12-d713-461a-8012-6a44a938a76e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.580289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958af12-d713-461a-8012-6a44a938a76e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.580566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958af12-d713-461a-8012-6a44a938a76e None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.581458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958af12-d713-461a-8012-6a44a938a76e None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:11.581833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958af12-d713-461a-8012-6a44a938a76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:11.583329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958af12-d713-461a-8012-6a44a938a76e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:11.595615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 218/435] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:25:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:11.602045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:11.704212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:11.790701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979195-acd0-43bf-8f36-a8f3d0146c87 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:11.823466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64eb1-eff0-4090-845b-4132a7de9488 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.824493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64eb1-eff0-4090-845b-4132a7de9488 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.824975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64eb1-eff0-4090-845b-4132a7de9488 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.826867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 219/436] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:11.833613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e960dc7-1e58-4c1c-b0ea-05c802ec35a7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.833982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e960dc7-1e58-4c1c-b0ea-05c802ec35a7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.834468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e960dc7-1e58-4c1c-b0ea-05c802ec35a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.843422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:11.844572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:11.845884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:11.845884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:11.862919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1e960dc7-1e58-4c1c-b0ea-05c802ec35a7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:11.864758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1e960dc7-1e58-4c1c-b0ea-05c802ec35a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:11.976239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 220/437] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:25:11.982201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:11.984827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:12.002324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e960dc7-1e58-4c1c-b0ea-05c802ec35a7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:12.083482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:12.138512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:12.168549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e960dc7-1e58-4c1c-b0ea-05c802ec35a7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:12.178768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 218/438] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:12.185343 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:12.235520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:12.236231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.236655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.236828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.259039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:12.270852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:12.273125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:12.280127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 221/439] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:12.284644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:12.375557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c7e81-a7bc-47d3-97aa-6e701ec6387a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:12.427597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:12.442321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.442321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.442321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.442321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:12.442321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:12.442321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 219/440] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:12.445085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:12.453353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f33d34-54eb-457e-b083-31543a4e9350 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:12.483041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:12.508515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87122df8-cebf-40bb-af7a-2a512c842f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:12.509095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122df8-cebf-40bb-af7a-2a512c842f6c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.509382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122df8-cebf-40bb-af7a-2a512c842f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.509666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122df8-cebf-40bb-af7a-2a512c842f6c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.510451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122df8-cebf-40bb-af7a-2a512c842f6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:12.510761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122df8-cebf-40bb-af7a-2a512c842f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:12.512161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122df8-cebf-40bb-af7a-2a512c842f6c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:12.523106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 222/441] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:12.524669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243f22-4d5e-4bdc-a4fb-dda3d014ffa4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.524964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243f22-4d5e-4bdc-a4fb-dda3d014ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.525243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243f22-4d5e-4bdc-a4fb-dda3d014ffa4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.526524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 223/442] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:12.528940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40243f22-4d5e-4bdc-a4fb-dda3d014ffa4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:12.533577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:12.575272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d31476-6bd2-4fa4-8f81-96a6b3e90f58 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:12.611974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b8a69-bb45-4d18-8710-7d4e014e12a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:12.612840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8a69-bb45-4d18-8710-7d4e014e12a7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.613123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8a69-bb45-4d18-8710-7d4e014e12a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.613402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8a69-bb45-4d18-8710-7d4e014e12a7 None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.614939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8a69-bb45-4d18-8710-7d4e014e12a7 None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:12.617330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8a69-bb45-4d18-8710-7d4e014e12a7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:12.618830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 220/443] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:12.620022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85ff5f-55a6-4948-a6ef-c36e00a4affc None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.620310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85ff5f-55a6-4948-a6ef-c36e00a4affc None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.620594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85ff5f-55a6-4948-a6ef-c36e00a4affc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.637155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6e85ff5f-55a6-4948-a6ef-c36e00a4affc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:12.638399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6e85ff5f-55a6-4948-a6ef-c36e00a4affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:12.642576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40243f22-4d5e-4bdc-a4fb-dda3d014ffa4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:12.679767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:12.680422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.680706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.680986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.709458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 221/444] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:12.711126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85ff5f-55a6-4948-a6ef-c36e00a4affc None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:12.743338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:12.755890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:12.757466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:12.760420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:12.835504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85ff5f-55a6-4948-a6ef-c36e00a4affc None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:12.872110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 224/445] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:25:12.873955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:12.874676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:12.874962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:12.875199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:12.875307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:12.876072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=6364bdd7a64e476ba4944148f2453c0b, scope.project.id=59923365865346149b07f6c3fd58b112) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:12.876380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:12.877889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:12.884881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 222/446] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=6364bdd7a64e476ba4944148f2453c0b => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:12.885630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:13.013108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846869d0-b9e4-4110-8920-f2556758a630 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:13.014545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:13.017027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:13.032273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342dadf-7922-45b0-a4bb-f2eaac34684e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:13.059520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:13.060360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:13.060648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:13.060929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:13.075574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:13.076829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:13.077115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:13.077391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] PATH_INFO: `/v3/projects/ab95a2af933c40dba08b776a8568e994` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:13.078801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=ab95a2af933c40dba08b776a8568e994)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:13.080023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:13.080135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:13.083031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 223/447] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/projects/ab95a2af933c40dba08b776a8568e994 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:13.089144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:13.090348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:13.091565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:13.092195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:13.092268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 225/448] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:13.096380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:13.235870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2b75a-adea-4e88-b158-fd7f8800e5d4 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:13.250733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50562e17-be46-4525-b1eb-5cdbfd86ff8a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:13.286979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:13.288765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:13.288765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:13.288765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] PATH_INFO: `/v3/groups/22ffb1807b304c9ba072604785a5f3e5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:13.290614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] RBAC: Authorizing `identity:get_group(group_id=22ffb1807b304c9ba072604785a5f3e5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:13.292084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:13.293948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 224/449] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:13 2022] GET /identity/v3/groups/22ffb1807b304c9ba072604785a5f3e5 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:13.301141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:13.301322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:13.301539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:13.301659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:13.301893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:13.302967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:13.303114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:13.304922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:13.317134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 226/450] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:13.323392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:13.330467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:13.355937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:13.422559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7f70-a787-4ca6-9d62-d2a6d92e1e84 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:13.443132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232f28-d95c-4438-bd2a-d5040ac26558 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:13.459179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:13.460404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:13.460685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:13.460963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:13.461845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] RBAC: Adding query filter params (group.id=22ffb1807b304c9ba072604785a5f3e5, role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=ab95a2af933c40dba08b776a8568e994) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:13.462167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:13.463635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:13.470008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 225/451] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:13 2022] GET /identity/v3/role_assignments?group.id=22ffb1807b304c9ba072604785a5f3e5&scope.project.id=ab95a2af933c40dba08b776a8568e994&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:13.501104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:13.501798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:13.502081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:13.502356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:13.621170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:13.624003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:13.668922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:13.755293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 227/452] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 08:25:13.761353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:13.851278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:13.867685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b1c29-506f-4bde-b406-4193cea2b648 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:13.904713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:13.905554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:13.905925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:13.906254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] PATH_INFO: `/v3/projects/59923365865346149b07f6c3fd58b112` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:13.907542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] RBAC: Authorizing `identity:get_project(project_id=59923365865346149b07f6c3fd58b112)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:13.909053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:13.910863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 226/453] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:25:13 2022] GET /identity/v3/projects/59923365865346149b07f6c3fd58b112 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:13.916847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:14.024249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9593-7161-4f23-a9bd-7872f3740051 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:14.054213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:14.062169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ae193-6ed8-456c-829d-a55a00525c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:14.077739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ae193-6ed8-456c-829d-a55a00525c05 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:14.077739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ae193-6ed8-456c-829d-a55a00525c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:14.077739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ae193-6ed8-456c-829d-a55a00525c05 None admin] PATH_INFO: `/v3/groups/dc4dde0350124cb3829106bf227905e4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:14.077739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ae193-6ed8-456c-829d-a55a00525c05 None admin] RBAC: Authorizing `identity:get_group(group_id=dc4dde0350124cb3829106bf227905e4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:14.077739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ae193-6ed8-456c-829d-a55a00525c05 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:14.077739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 228/454] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 08:25:13 2022] GET /identity/v3/groups/dc4dde0350124cb3829106bf227905e4 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:14.078518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:14.234381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec865d29-a079-4ca8-b776-2442ac27ab1e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:14.292844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20cdb8-2a0b-442f-9c8f-e8223830ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:14.293979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20cdb8-2a0b-442f-9c8f-e8223830ef73 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:14.294476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20cdb8-2a0b-442f-9c8f-e8223830ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:14.294949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20cdb8-2a0b-442f-9c8f-e8223830ef73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:14.296529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20cdb8-2a0b-442f-9c8f-e8223830ef73 None admin] RBAC: Adding query filter params (group.id=dc4dde0350124cb3829106bf227905e4, role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=59923365865346149b07f6c3fd58b112) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:14.297078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20cdb8-2a0b-442f-9c8f-e8223830ef73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:14.299770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20cdb8-2a0b-442f-9c8f-e8223830ef73 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:14.311042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 227/455] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 08:25:14 2022] GET /identity/v3/role_assignments?group.id=dc4dde0350124cb3829106bf227905e4&scope.project.id=59923365865346149b07f6c3fd58b112&role.id=fb047c0afbd247f98f75175d913fed8e => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:18.156823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3c870-fab4-4f36-ba16-70c4bb37b315 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:18.156823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3c870-fab4-4f36-ba16-70c4bb37b315 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:18.156823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3c870-fab4-4f36-ba16-70c4bb37b315 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:18.158612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 229/456] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:18.165162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bce4bf-00d4-4562-b5eb-af9ea492f07a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:18.165995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bce4bf-00d4-4562-b5eb-af9ea492f07a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:18.165995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bce4bf-00d4-4562-b5eb-af9ea492f07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:18.186974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-55bce4bf-00d4-4562-b5eb-af9ea492f07a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:18.188193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-55bce4bf-00d4-4562-b5eb-af9ea492f07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:18.200984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:18.262695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8826a-a38e-4dbe-8a2c-662c1534e199 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:18.263721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8826a-a38e-4dbe-8a2c-662c1534e199 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:18.264496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8826a-a38e-4dbe-8a2c-662c1534e199 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:18.267950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 230/457] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:25:18.278329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140379-0538-49de-a4d9-753a56da4cf3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:18.279268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140379-0538-49de-a4d9-753a56da4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:18.280029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140379-0538-49de-a4d9-753a56da4cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:18.291587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 228/458] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:18.336158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-37140379-0538-49de-a4d9-753a56da4cf3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:18.338278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-37140379-0538-49de-a4d9-753a56da4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:18.394904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bce4bf-00d4-4562-b5eb-af9ea492f07a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:18.524392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 231/459] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:18.583869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bce4bf-00d4-4562-b5eb-af9ea492f07a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:18.601618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140379-0538-49de-a4d9-753a56da4cf3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:18.623801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:18.624727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:18.625012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:18.625289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:18.637237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:18.638782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:18.647646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:18.659058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:18.661164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:18.664163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:18.664163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:18.664163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:18.664163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:18.664163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 229/460] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:18.684892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:18.856346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc198d-9f04-426f-b6a5-eabe01f5425f None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:18.864743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140379-0538-49de-a4d9-753a56da4cf3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:18.914089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:18.953749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:18.955551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:18.956327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:18.959769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:18.979521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b6f81-2439-45a9-a940-ad7ca55eac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:18.980673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b6f81-2439-45a9-a940-ad7ca55eac69 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:18.981176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b6f81-2439-45a9-a940-ad7ca55eac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:18.981666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b6f81-2439-45a9-a940-ad7ca55eac69 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:18.983020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b6f81-2439-45a9-a940-ad7ca55eac69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:18.983575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b6f81-2439-45a9-a940-ad7ca55eac69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:18.987173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b6f81-2439-45a9-a940-ad7ca55eac69 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:18.989925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:18.994019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:19.017715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 230/461] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:19.021957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b54ab-f6e3-4314-8c7a-94f0d2efce8d None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.021957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b54ab-f6e3-4314-8c7a-94f0d2efce8d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.021957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b54ab-f6e3-4314-8c7a-94f0d2efce8d None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.030188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 231/462] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:19.033319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee653b-0797-443f-b1ed-38386d58c1af None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.033844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee653b-0797-443f-b1ed-38386d58c1af None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.034327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee653b-0797-443f-b1ed-38386d58c1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:19.038561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:19.039441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:19.040280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:19.040280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:19.040280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:19.040280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:19.044181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 232/463] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:19.045787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:19.073915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-37ee653b-0797-443f-b1ed-38386d58c1af None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:19.076738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-37ee653b-0797-443f-b1ed-38386d58c1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:19.200780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:19.234301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 232/464] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:25:19.236932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee653b-0797-443f-b1ed-38386d58c1af None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:19.286486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a932-6dbf-45ae-b85b-952b748ff6dd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:19.354650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115679b0-a102-4561-8055-d6ec540328b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:19.355805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115679b0-a102-4561-8055-d6ec540328b0 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.356303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115679b0-a102-4561-8055-d6ec540328b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.356804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115679b0-a102-4561-8055-d6ec540328b0 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.358175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115679b0-a102-4561-8055-d6ec540328b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:19.360996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115679b0-a102-4561-8055-d6ec540328b0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:19.393880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee653b-0797-443f-b1ed-38386d58c1af None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:19.440164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:19.441037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.441610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.442052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.442951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:19.443711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:19.445322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:19.462445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 233/465] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:25:19 2022] POST /identity/v3/users => generated 248 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:25:19.465483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20050-155d-44be-8389-5be6c3608f9d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.466473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20050-155d-44be-8389-5be6c3608f9d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.467290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20050-155d-44be-8389-5be6c3608f9d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.477171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 233/466] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:19.477171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:19.478347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 234/467] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:19.480033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20050-155d-44be-8389-5be6c3608f9d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:19.572152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:19.585394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:19.704156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46edfd-a840-48fc-8cd8-9aa8221f4480 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:19.740715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20050-155d-44be-8389-5be6c3608f9d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:19.791017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639398c-51cc-4675-9e92-91d40c756ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:19.792693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639398c-51cc-4675-9e92-91d40c756ccb None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.793408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639398c-51cc-4675-9e92-91d40c756ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.793825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639398c-51cc-4675-9e92-91d40c756ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.807543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:19.808288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.808571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.808846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.809757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:19.814248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:19.821355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639398c-51cc-4675-9e92-91d40c756ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:19.824272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639398c-51cc-4675-9e92-91d40c756ccb None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a639398c-51cc-4675-9e92-91d40c756ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:19.855381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:19.857058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:19.858822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:19.858822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:19.858822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:19.858822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:19.858822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 234/468] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:19.860059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5369e3-cf9b-4de6-9187-7063799e96ad None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:19.863073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5369e3-cf9b-4de6-9187-7063799e96ad None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:19.863073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5369e3-cf9b-4de6-9187-7063799e96ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:19.886814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7e5369e3-cf9b-4de6-9187-7063799e96ad None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:19.888224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7e5369e3-cf9b-4de6-9187-7063799e96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:19.904690 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 235/469] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:25:19 2022] POST /identity/v3/users => generated 246 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:25:19.911411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:20.029823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 235/470] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:20.117395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5369e3-cf9b-4de6-9187-7063799e96ad None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:20.157108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:20.180819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb49e-9c92-4cf0-84b7-66713c237aaf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:20.195167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:20.264900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ee08a-2d51-44bd-8c47-448f4d6f6061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:20.266931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ee08a-2d51-44bd-8c47-448f4d6f6061 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:20.267465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ee08a-2d51-44bd-8c47-448f4d6f6061 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:20.267987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ee08a-2d51-44bd-8c47-448f4d6f6061 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:20.269295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ee08a-2d51-44bd-8c47-448f4d6f6061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:20.269879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ee08a-2d51-44bd-8c47-448f4d6f6061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:20.274093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ee08a-2d51-44bd-8c47-448f4d6f6061 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:20.300769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 236/471] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:20.305745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed2cc4-47be-45a8-a688-032f81f8d7af None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:20.305745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed2cc4-47be-45a8-a688-032f81f8d7af None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:20.305745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed2cc4-47be-45a8-a688-032f81f8d7af None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:20.309443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 237/472] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:20.315426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed2cc4-47be-45a8-a688-032f81f8d7af None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:20.359053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5369e3-cf9b-4de6-9187-7063799e96ad None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:20.437437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859081-04c2-4c3d-bbf2-14aebd5d28a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:20.439491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859081-04c2-4c3d-bbf2-14aebd5d28a4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:20.440240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859081-04c2-4c3d-bbf2-14aebd5d28a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:20.441779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859081-04c2-4c3d-bbf2-14aebd5d28a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:20.472087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79859081-04c2-4c3d-bbf2-14aebd5d28a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:20.477077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79859081-04c2-4c3d-bbf2-14aebd5d28a4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:20.484304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed2cc4-47be-45a8-a688-032f81f8d7af None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-79859081-04c2-4c3d-bbf2-14aebd5d28a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:20.508994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:20.510693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:20.512396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:20.512396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:20.512396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:20.512396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:20.512396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 236/473] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:20.512396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281cca4-195d-4fc1-8174-b6cbf9716ced None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:20.512396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281cca4-195d-4fc1-8174-b6cbf9716ced None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:20.513185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281cca4-195d-4fc1-8174-b6cbf9716ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:20.535747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f281cca4-195d-4fc1-8174-b6cbf9716ced None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:20.537629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f281cca4-195d-4fc1-8174-b6cbf9716ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:20.554496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:20.555078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:20.555356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:20.555606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:20.556331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:20.558495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:20.656348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 238/474] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:25:20 2022] POST /identity/v3/users => generated 249 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:25:20.657622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:20.682177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:20.704125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 237/475] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:20.776805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281cca4-195d-4fc1-8174-b6cbf9716ced None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:20.784023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf3c0-2a98-4308-a667-e5eaea71e369 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:20.822206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:20.852298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:20.853000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:20.853277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:20.853551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:20.858357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:20.858677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:20.860144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:20.894538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 239/476] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:20.902124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:20.979342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281cca4-195d-4fc1-8174-b6cbf9716ced None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:21.024535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:21.032703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:21.036279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:21.036279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:21.036279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:21.036279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:21.038207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:21.085434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.sql.core [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 08:25:21.085434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 08:25:21.085434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [parameters: {'id': '3c51d9d9d7854e1e84ea6d783f905ffd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 08:25:21.085434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80328) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 08:25:21.090111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ed5a-8eb9-49d4-825c-bd5d077ffec9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application conn.query(q) Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result.read() Jul 18 08:25:21.107968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 08:25:21.109178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application next(self.gen) Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application yield resource Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application next(self.gen) Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise self.value Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application session.commit() Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 08:25:21.110429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.session.flush() Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application compat.raise_( Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 08:25:21.111917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 08:25:21.112841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application conn.query(q) Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result.read() Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 08:25:21.114127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [parameters: {'id': '3c51d9d9d7854e1e84ea6d783f905ffd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:21.115379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 08:25:21.116182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:21.119918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 238/477] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 08:25:20 2022] POST /identity/v3/roles => generated 144 bytes in 344 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:21.131790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:21.160225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:21.161566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:21.162574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:21.162789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:21.164101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:21.166172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:21.244151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:21.268248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 240/478] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:25:20 2022] POST /identity/v3/users => generated 248 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:25:21.281958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e4691-6635-46c1-9c84-aa4c1c956c75 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:21.328725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049f606-5bf4-4161-ad20-d762a588c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:21.329567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049f606-5bf4-4161-ad20-d762a588c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:21.333424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049f606-5bf4-4161-ad20-d762a588c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:21.333424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049f606-5bf4-4161-ad20-d762a588c9e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:21.343966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049f606-5bf4-4161-ad20-d762a588c9e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-1049f606-5bf4-4161-ad20-d762a588c9e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:21.353361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:21.355293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 08:25:21.356891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:21.361390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 239/479] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:25:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:21.374113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:21.517437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c613-ea1c-4069-900a-3c0ec9b20838 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:21.554323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:21.586424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0f611-539b-4814-a373-dc34d0321f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:21.587625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0f611-539b-4814-a373-dc34d0321f73 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:21.588158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0f611-539b-4814-a373-dc34d0321f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:21.588835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0f611-539b-4814-a373-dc34d0321f73 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:21.590413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0f611-539b-4814-a373-dc34d0321f73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:21.590721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0f611-539b-4814-a373-dc34d0321f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:21.593504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0f611-539b-4814-a373-dc34d0321f73 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:21.611470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 241/480] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:22.195889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa65f4-361e-425d-824d-9a41a06d4873 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:22.196288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa65f4-361e-425d-824d-9a41a06d4873 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:22.196462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa65f4-361e-425d-824d-9a41a06d4873 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:22.198153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 240/481] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:22.204731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce2b0-a401-49a2-abc3-8972f028bf9f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:22.205060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce2b0-a401-49a2-abc3-8972f028bf9f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:22.205307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce2b0-a401-49a2-abc3-8972f028bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:22.231744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f1bce2b0-a401-49a2-abc3-8972f028bf9f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:22.232971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f1bce2b0-a401-49a2-abc3-8972f028bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:22.333791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 242/482] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:25:22.416557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa65f4-361e-425d-824d-9a41a06d4873 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:22.583549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa65f4-361e-425d-824d-9a41a06d4873 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:22.635812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:22.636678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:22.636963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:22.637235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:22.642798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:22.658956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:22.667674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:22.668629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:22.669479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:22.674143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 241/483] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:22.680980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bce2b0-a401-49a2-abc3-8972f028bf9f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:22.857958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bce2b0-a401-49a2-abc3-8972f028bf9f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:22.873136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:22.896265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:22.897650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:22.898162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:22.898448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:22.899329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:22.899643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:22.901284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:22.912080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 243/484] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:22.917430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:23.086531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df8ae6-24a8-41d8-b056-b4994e0f83da None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:23.139832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a10f2-24f1-4e65-a294-189c92bd6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:23.140529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a10f2-24f1-4e65-a294-189c92bd6db2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.140810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a10f2-24f1-4e65-a294-189c92bd6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.141083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a10f2-24f1-4e65-a294-189c92bd6db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.155177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a10f2-24f1-4e65-a294-189c92bd6db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:23.156658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a10f2-24f1-4e65-a294-189c92bd6db2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-355a10f2-24f1-4e65-a294-189c92bd6db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:23.180050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:23.181200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:23.182269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:23.182269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:23.182269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:23.182269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:23.182269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 242/485] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:23.190831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:23.221863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b57cdd-e255-482f-b971-86b30ab6ddec None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.235358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b57cdd-e255-482f-b971-86b30ab6ddec None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.235358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b57cdd-e255-482f-b971-86b30ab6ddec None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.235358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 243/486] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:23.235358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e7dc-44b9-4894-b20d-7c2d170d05b9 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.235358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e7dc-44b9-4894-b20d-7c2d170d05b9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.235358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e7dc-44b9-4894-b20d-7c2d170d05b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.266418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-86f7e7dc-44b9-4894-b20d-7c2d170d05b9 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:23.267668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-86f7e7dc-44b9-4894-b20d-7c2d170d05b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:23.366459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:23.397199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2243203-ffc9-48c8-90e3-cc94f6b51b5b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:23.419678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 244/487] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:23.451674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e7dc-44b9-4894-b20d-7c2d170d05b9 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:23.465212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:23.465920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.466202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.466474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.467203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:23.467507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:23.468877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:23.492768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 244/488] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:23.498050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:23.566094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:23.602110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e7dc-44b9-4894-b20d-7c2d170d05b9 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:23.630192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f172-72a7-4efe-9201-55d60f4e7235 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:23.671046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:23.671875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.672163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.672441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.679629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2819e82-1958-4ecc-aaf7-860ba4077857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:23.680462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819e82-1958-4ecc-aaf7-860ba4077857 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.680749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819e82-1958-4ecc-aaf7-860ba4077857 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.681024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819e82-1958-4ecc-aaf7-860ba4077857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.681150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:23.682716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:23.701274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:23.702293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:23.703211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 245/489] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:23.706983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2819e82-1958-4ecc-aaf7-860ba4077857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:23.710738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-d2819e82-1958-4ecc-aaf7-860ba4077857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:23.721734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:23.723962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 245/490] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:23.726815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc487b-77ec-4426-8913-468949c36af9 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.728543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc487b-77ec-4426-8913-468949c36af9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.728543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc487b-77ec-4426-8913-468949c36af9 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.728543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 246/491] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:23.735654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc487b-77ec-4426-8913-468949c36af9 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:23.789531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:23.851405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:23.859275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8767220-c4b6-4d60-af55-ba6e070b1bf1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:23.891230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc487b-77ec-4426-8913-468949c36af9 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:23.903541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526410ce-dd73-4266-8ec5-061f96dbf018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:23.904229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526410ce-dd73-4266-8ec5-061f96dbf018 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.904522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526410ce-dd73-4266-8ec5-061f96dbf018 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.904802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526410ce-dd73-4266-8ec5-061f96dbf018 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.906101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526410ce-dd73-4266-8ec5-061f96dbf018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:23.906419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526410ce-dd73-4266-8ec5-061f96dbf018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:23.908271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526410ce-dd73-4266-8ec5-061f96dbf018 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:23.937998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:23.939097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.939612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.940325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.942013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:23.942746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:23.945464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:23.956363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 246/492] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 08:25:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:23.962622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fc6f-dc70-412a-82c4-09e53cead3ce None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:23.962622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fc6f-dc70-412a-82c4-09e53cead3ce None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:23.962622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fc6f-dc70-412a-82c4-09e53cead3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:23.963115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 247/493] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:23.964347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:23.981115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f3a7fc6f-dc70-412a-82c4-09e53cead3ce None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:23.983122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f3a7fc6f-dc70-412a-82c4-09e53cead3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:24.077768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 247/494] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:24.077768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fc6f-dc70-412a-82c4-09e53cead3ce None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:24.098554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:24.102877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bcb57-d9a8-41da-b649-7e6d1e212ca5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:24.166334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:24.168367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.168502 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:24.168875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.169377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.189797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fc6f-dc70-412a-82c4-09e53cead3ce None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:24.237223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4c84-0ba7-4344-8fa8-2dc705014f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:24.238458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4c84-0ba7-4344-8fa8-2dc705014f0f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.238735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4c84-0ba7-4344-8fa8-2dc705014f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.239014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4c84-0ba7-4344-8fa8-2dc705014f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.251433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4c84-0ba7-4344-8fa8-2dc705014f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:24.252977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4c84-0ba7-4344-8fa8-2dc705014f0f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a96d4c84-0ba7-4344-8fa8-2dc705014f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:24.273048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:24.274042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:24.274903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:24.274903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:24.274903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:24.274903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:24.274903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 248/495] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:24.275709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0cc59-e62d-49bc-8b12-5e30c10c26a1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.275872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0cc59-e62d-49bc-8b12-5e30c10c26a1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.276154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0cc59-e62d-49bc-8b12-5e30c10c26a1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.277652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 249/496] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:24.278241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0cc59-e62d-49bc-8b12-5e30c10c26a1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:24.290021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:24.292790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:24.413884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0cc59-e62d-49bc-8b12-5e30c10c26a1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:24.429642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:24.436488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 248/497] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:24.442713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:24.463937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1f34-b8f5-480c-bda5-5abf38869ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:24.464769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1f34-b8f5-480c-bda5-5abf38869ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.465059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1f34-b8f5-480c-bda5-5abf38869ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.465340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1f34-b8f5-480c-bda5-5abf38869ec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.467697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:24.478611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1f34-b8f5-480c-bda5-5abf38869ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a71d1f34-b8f5-480c-bda5-5abf38869ec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:24.486701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:24.488677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 250/498] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:24.490805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1780a81-95be-4fdf-9447-0f562cf281a6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.492472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1780a81-95be-4fdf-9447-0f562cf281a6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.492472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1780a81-95be-4fdf-9447-0f562cf281a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.511523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f1780a81-95be-4fdf-9447-0f562cf281a6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:24.512809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f1780a81-95be-4fdf-9447-0f562cf281a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:24.573824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7f400-ca1d-40b3-ace2-40e1f678ee43 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:24.603611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 251/499] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:24.605570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c300b-04b4-4cf6-8e1c-dcc2f89a9d0b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.606110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c300b-04b4-4cf6-8e1c-dcc2f89a9d0b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.606552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c300b-04b4-4cf6-8e1c-dcc2f89a9d0b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.609069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 252/500] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:24.609958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c300b-04b4-4cf6-8e1c-dcc2f89a9d0b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:24.622836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:24.623881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.624352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.624805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.625775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:24.626248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:24.627710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:24.643067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 249/501] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:24.643680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:24.730871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:24.744280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c300b-04b4-4cf6-8e1c-dcc2f89a9d0b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:24.769787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:24.785510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba892e6-a30d-4255-805c-e8ff40311a46 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:24.785930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e9128-ad30-46a2-91a9-5fdca9e6070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:24.787831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9128-ad30-46a2-91a9-5fdca9e6070c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.788437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9128-ad30-46a2-91a9-5fdca9e6070c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.788822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9128-ad30-46a2-91a9-5fdca9e6070c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.801411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e9128-ad30-46a2-91a9-5fdca9e6070c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:24.803589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e9128-ad30-46a2-91a9-5fdca9e6070c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e98e9128-ad30-46a2-91a9-5fdca9e6070c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:24.823793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:24.824754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:24.825633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:24.825633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:24.825633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:24.825633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:24.825900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:24.825999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 253/502] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:24.826068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.826068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.826185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.826731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e9e-fd03-4233-9389-67c379fa3fb3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:24.826731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e9e-fd03-4233-9389-67c379fa3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:24.826899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:24.826966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e9e-fd03-4233-9389-67c379fa3fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:24.827153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:24.828566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:24.838412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 250/503] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:24.839275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:24.848104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e4407e9e-fd03-4233-9389-67c379fa3fb3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:24.849366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e4407e9e-fd03-4233-9389-67c379fa3fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:24.928237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 254/504] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:24.929518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e9e-fd03-4233-9389-67c379fa3fb3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:24.972403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38546-6a40-4672-9717-869bb42869b4 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.000676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:25.017754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695939c-a489-4587-b147-275675c80be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.018676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695939c-a489-4587-b147-275675c80be3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.022194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695939c-a489-4587-b147-275675c80be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.022194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695939c-a489-4587-b147-275675c80be3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.033881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695939c-a489-4587-b147-275675c80be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-8695939c-a489-4587-b147-275675c80be3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:25.041943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:25.043138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:25.044131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:25.049856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 251/505] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:25.051357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695939c-a489-4587-b147-275675c80be3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.058151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e9e-fd03-4233-9389-67c379fa3fb3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.073460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:25.120553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.121859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.122312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.122765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.135954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.138319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:25.163396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:25.165111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 255/506] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:25:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:25.166906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.202887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695939c-a489-4587-b147-275675c80be3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.264493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.265536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.266076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.266571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.268068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:25.268612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.271292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.285598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2673ea-d201-4ff9-8502-6ee5c5a16ec8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.292108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 252/507] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:25.293792 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.328749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.329799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.330189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.330508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.343922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.345848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.348447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:25.369436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:25.371465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:25.373091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:25.373091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:25.373091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:25.373091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:25.373091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 256/508] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:25.373091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.398749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:25.421169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0a585-bbd3-443b-9b15-2d0ad7cff493 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.462694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.463529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.463979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.464434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.482471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.484600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:25.504145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:25.505430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:25.509403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:25.509403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:25.509403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:25.509403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:25.509403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 253/509] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:25.509403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.532565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187cc1e-6294-43e8-b42c-64abc6d2f089 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.583121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.584179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.584529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.584941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.586028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:25.586479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.588266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.598279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 257/510] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:25.599310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.638692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:25.647720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f96a-ce93-464a-a180-e5394576a672 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.687493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.688359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.688977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.689280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.690293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:25.690771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.692647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.721644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:25.741511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 254/511] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:25.742796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.750111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6c38-30d5-42ce-8f55-9a3ce88d7d1a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.805863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.806666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.806951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.807222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.815763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.819389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:25.850135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:25.851841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:25.853579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 258/512] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:25.854694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:25.902107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63fd37-5825-4684-81b1-9110298a19aa None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:25.952197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:25.953260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:25.953782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:25.954243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:25.955483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:25.955990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:25.958222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:25.980206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 255/513] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:25.981603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.002327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:26.029029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ae73-0111-4822-b985-4ba4bd697ba2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:26.076112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543495-0dca-406a-8d15-6066420316fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:26.076707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543495-0dca-406a-8d15-6066420316fa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:26.076985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543495-0dca-406a-8d15-6066420316fa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:26.077259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543495-0dca-406a-8d15-6066420316fa None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:26.078035 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543495-0dca-406a-8d15-6066420316fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:26.078341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543495-0dca-406a-8d15-6066420316fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:26.079785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543495-0dca-406a-8d15-6066420316fa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:26.090505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:26.094839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 259/514] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:26.095916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543495-0dca-406a-8d15-6066420316fa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.145718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c1450-a22e-4909-8ecc-1335294475e9 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:26.202625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:26.203987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:26.204432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:26.204838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:26.222856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:26.225323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:26.232899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543495-0dca-406a-8d15-6066420316fa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:26.246661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:26.248357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:26.250030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:26.250030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:26.250030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:26.250030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:26.250030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 256/515] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:26.250030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.278387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:26.279040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:26.279318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:26.279594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:26.364356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:26.371453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:26.377813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:26.377813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:26.415563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00290cd5-5a97-4f9e-bc9f-a70f77c5ce29 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:26.460837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:26.461584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:26.462011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:26.462347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:26.463296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:26.464204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:26.465588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:26.487091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 257/516] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:26.487959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.512713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 260/517] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:26.514127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.637031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47cc8-770e-433a-9faa-3e70cf314533 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:26.650813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:26.654134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d731-9f4e-4417-8e15-c00b0a5a4ee2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:26.666263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:26.679964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:26.681000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:26.681384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:26.681845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:26.693335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:26.695295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:26.698122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:26.699178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:26.699518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:26.699831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:26.700651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:26.702205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:26.715671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:26.716800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 258/518] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:26.717959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.811201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 261/519] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:25:26 2022] POST /identity/v3/users => generated 247 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:25:26.812645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.839362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b78fc-d545-423c-91fe-1aa9522a0171 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:26.886372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:26.887726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:26.889181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:26.889725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:26.890693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:26.891264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:26.892907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:26.912393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 259/520] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:26.913870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:26.998975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:27.019999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f2c6-feb4-4401-b4f3-0eab0cb4d76d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:27.093765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:27.093765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:27.093765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:27.093765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:27.094539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=ec22f82d0e7745f282c5837459fba05e) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:27.094539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:27.094539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:27.096781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e39c2-b2be-45f2-8a19-45731838d820 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:27.100466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 262/521] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:26 2022] GET /identity/v3/role_assignments?user.id=ec22f82d0e7745f282c5837459fba05e&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:27.101347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:27.143342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:27.184395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:27.187391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:27.188407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:27.189285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:27.225975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:27.232481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:27.263313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:27.265282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:27.267538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:27.267538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:27.267538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:27.267538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:27.267538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 260/522] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:27.268833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:27.289799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e071cc-b1e4-4996-8029-cada5bde42d7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:27.379084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:27.381220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:27.381576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:27.381871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:27.383501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:27.385337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:27.386881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:27.420767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 263/523] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jul 18 08:25:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:27.422152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:27.438468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:27.452168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e927-ac3e-44eb-a57d-4febf2706e18 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:27.539763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:27.542536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:27.543327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:27.544097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:27.561275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:27.564293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:27.582348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:27.594214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:27.595204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:25:27.596101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:27.602281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 261/524] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:27.606778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:27.607798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6848cd-3eb7-41a3-98e3-84c9cf852265 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:27.648584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:27.649425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:27.649873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:27.650262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:27.651130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:27.651649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:27.653254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:27.668876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 264/525] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:27.670108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:27.791878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8531bc5-8dfa-49c7-9e50-1f17a5fb25d7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:27.804423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba43e-87ee-49a7-a336-935832c6deff None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:27.840845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:27.842112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:27.842613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:27.844778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:27.846621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:27.847188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:27.850993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:27.860748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:27.861558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:27.861972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:27.862370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:27.870301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:27.894136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 265/526] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 08:25:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:27.895158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:27.896582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:27.959078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:27.962598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:28.042501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1030-5e74-4c9f-9469-a76bd601ae28 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:28.105314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:28.107031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:28.107579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:28.108224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:28.121427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:28.124305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:28.131250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 262/527] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:28.132354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:28.153935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:28.154969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:28.155944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:28.159622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 266/528] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:28.161065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:28.229042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:28.247222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:28.307439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232cb6-d7d8-47c8-afd7-c77228b380c5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:28.314750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237decf-e529-47dc-a2b3-9e8bd9822ddb None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:28.358581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:28.359630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:28.360437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:28.360867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:28.373825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:28.375663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:28.376036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:28.376662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:28.399727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:28.402793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:28.438635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:28.439761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:28.440726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:28.440726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:28.440726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:28.440726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:28.444336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 267/529] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:28.446250 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:28.457705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:28.457705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:28.581356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:28.639333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6469b-56f9-44c3-a412-da15c602eae0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:28.657111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:28.682771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 263/530] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:28.684794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:28.709204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:28.709885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:28.710394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:28.710885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:28.712415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:28.712971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:28.715798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:28.756693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 268/531] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:28.758642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:28.888171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0710afc-00db-445f-9e3d-e43fcca193b0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:28.903209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594ae13-a8aa-4350-9018-aa8dc72f9b23 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:28.928325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:28.929146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:28.929430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:28.929755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:28.942108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:28.944173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:28.965048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:28.966280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:28.967531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:28.967531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:28.967531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:28.967531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:28.967531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 269/532] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:28.967531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:28.976510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:28.977505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:28.977969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:28.978426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:28.979999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:28.980912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:28.984026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:28.994289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:29.008191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 264/533] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:29.009768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:29.045591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:29.084268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21c000-799c-4b6d-bfb2-88f9a4879d76 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:29.124103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:29.124768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:29.125075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:29.125323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:29.126470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=df173c85777f45dd8ed9fb11bad366b2) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:29.126640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:29.128151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:29.135600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 270/534] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:28 2022] GET /identity/v3/role_assignments?user.id=df173c85777f45dd8ed9fb11bad366b2&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:29.136507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:29.231308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c4095-c1bd-4700-9d97-45c0cdce9660 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:29.242256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:29.254684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55672a2-8a4e-435b-9267-1a841db3b347 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:29.296314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:29.297401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:29.297763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:29.302723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:29.306038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:29.306733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:29.307057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:29.307342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:29.308093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:29.308400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:29.311221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:29.321999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:29.329390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:29.342410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 265/535] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:29.351146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:29.365670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:29.367448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:29.369095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:29.370848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 271/536] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:29.385475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:29.537040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761f84f-0765-47f1-90a9-de9b25824a09 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:29.574962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:29.580636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:29.581459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:29.582426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:29.582426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:29.600113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:29.601705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:29.621085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:29.623596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:29.626984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 266/537] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:29.633331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:29.709571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7afaa1-4772-4b96-b750-03c05f24c418 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:29.785203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:29.785818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:29.786105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:29.786899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:29.787726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:29.788042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:29.790094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:29.802187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ed04-3963-4eb1-952b-80e1b50e02a0 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:29.815797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 272/538] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:29.826134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:29.833971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:29.886771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e261d-66a4-42c9-8c0f-ea1837e31585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:29.887456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e261d-66a4-42c9-8c0f-ea1837e31585 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:29.887742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e261d-66a4-42c9-8c0f-ea1837e31585 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:29.888019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e261d-66a4-42c9-8c0f-ea1837e31585 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:29.888838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e261d-66a4-42c9-8c0f-ea1837e31585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:29.889149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e261d-66a4-42c9-8c0f-ea1837e31585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:29.890745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e261d-66a4-42c9-8c0f-ea1837e31585 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:29.893879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:29.906640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 267/539] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:29.908100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511eab5-ff13-4b63-bfcc-234faae77163 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:29.908398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511eab5-ff13-4b63-bfcc-234faae77163 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:29.908683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511eab5-ff13-4b63-bfcc-234faae77163 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:29.916490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 268/540] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:29.916490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511eab5-ff13-4b63-bfcc-234faae77163 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:30.019184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fd481-375a-4726-a603-db1548e1b126 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:30.032050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511eab5-ff13-4b63-bfcc-234faae77163 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:30.071518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08c5e0-1b23-4531-be4c-d69fc498a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:30.072196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c5e0-1b23-4531-be4c-d69fc498a39c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:30.072495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c5e0-1b23-4531-be4c-d69fc498a39c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:30.072743 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c5e0-1b23-4531-be4c-d69fc498a39c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:30.073595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08c5e0-1b23-4531-be4c-d69fc498a39c None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=b8d2f745ac2a4388a7890250141a4e2a) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:30.073940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08c5e0-1b23-4531-be4c-d69fc498a39c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:30.075431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08c5e0-1b23-4531-be4c-d69fc498a39c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:30.082333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 269/541] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:29 2022] GET /identity/v3/role_assignments?user.id=b8d2f745ac2a4388a7890250141a4e2a&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:30.084319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3875a-4670-4aec-b322-0a70f29788b8 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:30.084610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3875a-4670-4aec-b322-0a70f29788b8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:30.084926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3875a-4670-4aec-b322-0a70f29788b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:30.088942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:30.090815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:30.091795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:30.092588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:30.094710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=b40cb94150444c81ab1de3c6c1c1ed7f) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:30.095581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:30.099707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:30.104378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-aaf3875a-4670-4aec-b322-0a70f29788b8 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:30.105650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-aaf3875a-4670-4aec-b322-0a70f29788b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:30.112309 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 273/542] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:29 2022] GET /identity/v3/role_assignments?user.id=b40cb94150444c81ab1de3c6c1c1ed7f&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:30.178098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:30.191339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 270/543] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:30.266221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:30.451242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:30.511858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374909a0-123d-49ff-823e-9fe7f0c9a03f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:30.576661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:30.577490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:30.577797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:30.578076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:30.593108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd45e-6dad-4e8f-a45d-cfed5cb395b1 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:30.593614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:30.594196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd45e-6dad-4e8f-a45d-cfed5cb395b1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:30.594690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd45e-6dad-4e8f-a45d-cfed5cb395b1 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:30.596526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 271/544] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:30.602363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289509-99e8-4449-9bf8-4961931ff648 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:30.602931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289509-99e8-4449-9bf8-4961931ff648 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:30.603403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289509-99e8-4449-9bf8-4961931ff648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:30.607569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:30.608448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:30.609249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:30.609912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 274/545] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:30.621223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:30.644438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-88289509-99e8-4449-9bf8-4961931ff648 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:30.647133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-88289509-99e8-4449-9bf8-4961931ff648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:30.794748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 272/546] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:25:30.839286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289509-99e8-4449-9bf8-4961931ff648 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:30.887968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d57e8-761e-4498-8184-97d0dec00f54 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:30.942083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:30.967112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:30.968276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:30.968778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:30.969268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:30.970665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:30.971185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:30.974545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:31.009865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 275/547] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:31.014391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:31.178363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289509-99e8-4449-9bf8-4961931ff648 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:31.229367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:31.237604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e6fda-7f3f-497f-8ab7-2ac1c2510360 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:31.276369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:31.277183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:31.277464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:31.277763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:31.300367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:31.309291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:31.310199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:31.310484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:31.310761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:31.313808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:31.315826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:31.316821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:31.319799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 273/548] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:31.335970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:31.336159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:31.337475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:31.403702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:31.405466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:31.407194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:31.407194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:31.407194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:31.407194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:31.423526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 276/549] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:31.446859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:31.516736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791b8b3-37e2-4a67-92d6-f01e3bc372c4 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:31.564531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:31.565188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:31.565299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:31.565475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:31.565773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:31.566634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:31.566938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:31.569387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:31.591694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 274/550] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:31.598045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:31.694274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:31.715704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780ccf-d06e-47c6-95bc-33d5a6b78735 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:31.780620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9700d5-d81b-4fe4-bc21-8838c47f6401 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:31.791042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:31.791731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:31.792022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:31.792301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:31.793044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:31.793351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:31.794968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:31.829413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 277/551] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:31.850773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:31.853774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798ba7e-0b21-47a5-869e-17fe1c8eff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:31.855299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ba7e-0b21-47a5-869e-17fe1c8eff3f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:31.855798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ba7e-0b21-47a5-869e-17fe1c8eff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:31.856297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ba7e-0b21-47a5-869e-17fe1c8eff3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:31.877470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798ba7e-0b21-47a5-869e-17fe1c8eff3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:31.881551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798ba7e-0b21-47a5-869e-17fe1c8eff3f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3798ba7e-0b21-47a5-869e-17fe1c8eff3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:31.913515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:31.914557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:31.915423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:31.915423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:31.915423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:31.915423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:31.915423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 275/552] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:31.916376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9212e-62da-4fe2-8d9f-ad23fe77f463 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:31.917332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9212e-62da-4fe2-8d9f-ad23fe77f463 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:31.917332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9212e-62da-4fe2-8d9f-ad23fe77f463 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:31.923352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 276/553] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:31.924196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9212e-62da-4fe2-8d9f-ad23fe77f463 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:31.972986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073d2b0-6d53-4d26-b866-d3a35993829c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:31.975464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:32.018568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f35c7-6bef-4ca0-b6cb-17cf6539cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.019721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f35c7-6bef-4ca0-b6cb-17cf6539cb05 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.020191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f35c7-6bef-4ca0-b6cb-17cf6539cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.020650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f35c7-6bef-4ca0-b6cb-17cf6539cb05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.030278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f35c7-6bef-4ca0-b6cb-17cf6539cb05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:32.032117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f35c7-6bef-4ca0-b6cb-17cf6539cb05 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:32.048340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9c3f35c7-6bef-4ca0-b6cb-17cf6539cb05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:32.049192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:32.050199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:32.051209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:32.052873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9212e-62da-4fe2-8d9f-ad23fe77f463 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:32.056752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 278/554] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:32.057725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472c12-0510-47ce-b2f5-3ca9b307aab4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.058034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472c12-0510-47ce-b2f5-3ca9b307aab4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.063713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472c12-0510-47ce-b2f5-3ca9b307aab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.077506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0f472c12-0510-47ce-b2f5-3ca9b307aab4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:32.078854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0f472c12-0510-47ce-b2f5-3ca9b307aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:32.097310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.099502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.100154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.100619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.101804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:32.102317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:32.103929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:32.122356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 277/555] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:32.124444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:32.204815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 279/556] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:32.206854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472c12-0510-47ce-b2f5-3ca9b307aab4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:32.287882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b65fc4-ff3f-4bba-8f0a-c1b066f4ca4a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:32.335306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.336426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.336921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.337445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.338543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:32.339085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:32.340878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:32.362712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 278/557] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:32.364159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:32.390299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:32.392695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:32.408460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472c12-0510-47ce-b2f5-3ca9b307aab4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:32.477034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.478567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.479187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.479685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.486078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d3c0-b4c2-4ea3-83d5-887eda00cc66 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:32.495699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:32.498449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:32.528333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:32.529406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:32.530823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 08:25:32.531764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:32.532765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.533312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.533823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.538427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 280/558] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:32.540198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:32.548332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:32.557048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:32.558358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:32.559278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:32.562062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 279/559] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:32.563251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:32.648181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:32.680814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1140e37-3069-4901-ac9d-6689dd548184 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:32.706484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d25c-d128-40e1-bfc9-1fc65ed83bc9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:32.719032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.719717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.720075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.720365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.721244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:32.721552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:32.723075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:32.745860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.746527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.746811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.747389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.748412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 280/560] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:32.749252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:32.772550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:32.822522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:32.824000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:32.862047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806d6ae-3215-4e93-8655-d15508ff5220 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:32.904289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:32.913922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c175c9-23f5-494b-a8b0-bb4216f212fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:32.915134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c175c9-23f5-494b-a8b0-bb4216f212fa None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.915517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c175c9-23f5-494b-a8b0-bb4216f212fa None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.915904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c175c9-23f5-494b-a8b0-bb4216f212fa None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.917194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c175c9-23f5-494b-a8b0-bb4216f212fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:32.917720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c175c9-23f5-494b-a8b0-bb4216f212fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:32.920341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c175c9-23f5-494b-a8b0-bb4216f212fa None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:32.936835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 281/561] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:32.938618 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1341-f4a5-42f0-aae0-66539092c6e4 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.938915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1341-f4a5-42f0-aae0-66539092c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.939208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1341-f4a5-42f0-aae0-66539092c6e4 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.947137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 282/562] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:32.947328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 281/563] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:32.947409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194b8c-de8e-4762-9e4d-281d0e96c6e7 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:32.947409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194b8c-de8e-4762-9e4d-281d0e96c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:32.947409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194b8c-de8e-4762-9e4d-281d0e96c6e7 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:32.947619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:32.947703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 283/564] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:32.947703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab194b8c-de8e-4762-9e4d-281d0e96c6e7 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.010427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:33.061819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bc3d6-7d4a-4451-b1e3-718f9de5ecf7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.077635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab194b8c-de8e-4762-9e4d-281d0e96c6e7 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.103637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.104441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.104717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.104990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.116787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:33.118463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:33.121342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693062b9-9838-4a2b-af8c-5cb0fc8a9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.122189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693062b9-9838-4a2b-af8c-5cb0fc8a9c9d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.122475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693062b9-9838-4a2b-af8c-5cb0fc8a9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.122752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693062b9-9838-4a2b-af8c-5cb0fc8a9c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:33.138107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:33.139251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:33.140374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:33.140374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:33.140374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:33.140374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:33.140374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 282/565] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:33.140374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.142119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693062b9-9838-4a2b-af8c-5cb0fc8a9c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:33.144033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693062b9-9838-4a2b-af8c-5cb0fc8a9c9d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-693062b9-9838-4a2b-af8c-5cb0fc8a9c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:33.170741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:33.171766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:33.172676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:33.172676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:33.172676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:33.172676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:33.172676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 284/566] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:33.173952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7c61c-89b0-424e-a7f3-579664d84739 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.174421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7c61c-89b0-424e-a7f3-579664d84739 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.174905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7c61c-89b0-424e-a7f3-579664d84739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.193321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b2f7c61c-89b0-424e-a7f3-579664d84739 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:33.194558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b2f7c61c-89b0-424e-a7f3-579664d84739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:33.240954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:33.265365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23839113-454c-445e-b108-0857d4bfb013 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.268019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:33.268549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 285/567] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:33.269825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfac41-089d-4a7b-93fd-452e5f40aaf0 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.270124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfac41-089d-4a7b-93fd-452e5f40aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.270405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfac41-089d-4a7b-93fd-452e5f40aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.291359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-01bfac41-089d-4a7b-93fd-452e5f40aaf0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:33.292578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-01bfac41-089d-4a7b-93fd-452e5f40aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:33.304046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.304851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.305135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.305413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.316810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:33.328874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:33.350878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:33.352857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:33.354951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:33.354951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:33.354951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:33.354951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:33.356936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 283/568] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:33.357977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.375569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 286/569] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:33.376458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfac41-089d-4a7b-93fd-452e5f40aaf0 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.510811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfac41-089d-4a7b-93fd-452e5f40aaf0 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.513600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:33.537334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94eef-61df-4957-908a-f6dc51888c45 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.566037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.566837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.567126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.567983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.569003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:33.569313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:33.570750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:33.581501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.582089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.582366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.582641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.583929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:33.584228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:33.584796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 287/570] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:33.585795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:33.586265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.609296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 284/571] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:33.610538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.635220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:33.723030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a04325-7377-4fbd-9d3b-1aabe6730e21 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.736599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830436-b7c8-4f35-84ec-edfb58573eb9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.773386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.774095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.774383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.774659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.775390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:33.775698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:33.777091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:33.785175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.787227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.787707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.788182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.790681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 285/572] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:33.791589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.808300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:33.824115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:33.825181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:33.826364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:33.834400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 288/573] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:33.834984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:33.865605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:33.883298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:33.913088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e110e8d-ede6-4b60-9fca-e480cfb37785 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.960962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:33.961951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:33.962331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:33.962689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:33.968129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27752667-1a55-4dff-a1ea-9f29b9670820 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:33.977092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:33.987090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:33.989421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:33.991101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 286/574] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:33.992435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.018634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.020018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.021183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.021795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.034814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.038262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:34.065749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:34.067680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 289/575] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:34.069768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.115301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4f33f-a2bf-417f-9ae6-4d021754a6b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.160721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.163524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.164110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.164400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.167772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:34.169372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:34.172803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.174320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.187840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e24824-12be-4648-8650-6dfeab29e375 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:34.189866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:34.191507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:34.193940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 287/576] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:34.196543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.228812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.229620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.229993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.230262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.238468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.239981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:34.255587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:34.258409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 290/577] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:34.260016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.327262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8d391-019d-4804-bda4-c72457d15f80 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.368654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.369253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.369528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.369830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.370581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:34.370888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.372264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.381434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 288/578] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:34.382040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.384866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beccefa-380a-4f9d-8cba-7cf12a6b3b2e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.421603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.422314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.422602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.422878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.423639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:34.423953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.425351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.437598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 291/579] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:34.438529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.452300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:34.455794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:34.504515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c25b2-b2a1-4ace-9246-7433be757b88 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.556903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.557805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.557965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.558161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.559046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:34.559352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.560902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.579450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1ebc-f6ce-4a03-8dcf-1354f9b035d2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.585421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 289/580] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:34.586521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.631870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.632704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.633071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.633422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.634505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:34.634886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.636963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.655540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 292/581] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:34.657132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.725428 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da605a8c-fa18-41d8-af6d-a6cd9ef64659 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.745307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:34.766512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.766807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:34.767477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.767477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.767727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.768480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:34.768786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.770273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.785447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 290/582] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:34.789010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.812093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0dc9-bebb-414e-92db-e692854399d7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.851480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.852281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.852578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.852844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:34.869983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:34.872534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:34.903013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:34.904110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:34.904982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:34.904982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:34.904982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:34.904982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:34.909870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 293/583] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:34.911522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:34.944809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0be44-9a8f-41a3-bfe1-7d48838162f8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:34.992526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:34.993425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:34.993897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:34.994243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:35.008521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:35.010077 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:35.038402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:35.040217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:35.041944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:35.041944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:35.041944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:35.041944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:35.041944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 291/584] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:35.041944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:35.057631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee096f-e38d-4529-902c-97fbf709d0c7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:35.085340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:35.086020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:35.106340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:35.107301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:35.107673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:35.108034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:35.120515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:35.122165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:35.146839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:35.148809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:35.158425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:35.158425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:35.158425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:35.158425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:35.158425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 294/585] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:35.158425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:35.187017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80402-1f19-4ff6-8882-c9cecbdeb23c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:35.227031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:35.229140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:35.229140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:35.229140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/ec22f82d0e7745f282c5837459fba05e/roles/7dd1048f7a5241ea811f20171d0b4bd4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:35.246765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=ec22f82d0e7745f282c5837459fba05e, role_id=7dd1048f7a5241ea811f20171d0b4bd4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:35.248232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:35.305483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a7d8b-0432-4fae-810b-79dabfdc16ac None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:35.323612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 292/586] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:25:35 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/ec22f82d0e7745f282c5837459fba05e/roles/7dd1048f7a5241ea811f20171d0b4bd4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:35.324741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:35.356921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:35.357902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:35.358379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:35.358810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:35.359839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=083f9aa9e5d84adbb8a82f1b0addd788) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:35.360368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:35.362589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:35.381719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 295/587] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:35 2022] GET /identity/v3/role_assignments?user.id=083f9aa9e5d84adbb8a82f1b0addd788&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:35.381719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:35.454986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:35.514584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:35.555550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78034a-2a48-4688-a37f-d160e2f69869 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:35.624985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:35.626016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:35.626159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:35.627217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:35.628234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:35.628854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:35.632209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:35.640449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e6cb-f8bb-4f0c-9bfb-4df20e823c3b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:35.658017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 293/588] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:35.659907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:35.722328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:35.724757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:35.726222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:35.726923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:35.728773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:35.729572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:35.734004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:35.763407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 296/589] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:35.765143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:35.897246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb205c-97f1-4e25-b223-be198e557a9a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:35.968650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:35.970066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:35.970731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:35.971313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:35.972927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:35.974010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:35.976790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:35.988442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:35.994628 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:36.012655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 294/590] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:36.012655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:36.016317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3e24-a597-4d5a-a575-37fc227efad6 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:36.097610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:36.100087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:36.101494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:36.102219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:36.125025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:36.128518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:36.161747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:36.163862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:25:36.166014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:36.174199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 297/591] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:36.175952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:36.236789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8679f2f-144a-4a88-9d16-7dfa160f8ab6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:36.310691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:36.312701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:36.313397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:36.314153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:36.332640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:36.336810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:36.373040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:36.375218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 08:25:36.377402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:36.389301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 295/592] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:36.391104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:36.409563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2bb0d-f6df-4429-8222-0e29424b0c0c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:36.492722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:36.494470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:36.495453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:36.496182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:36.513471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:36.515053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:36.518039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:36.556377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:36.559972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:36.561820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:36.569180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 298/593] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:36.569180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:36.609800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:36.637834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e63bcf-a453-419c-bae8-85c567c604e5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:36.721022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:36.722955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:36.724193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:36.725271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:36.728587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:36.729366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:36.732376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:36.776130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 296/594] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 08:25:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:36.778066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:36.798275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895497-6e74-4a42-9ed6-35805527fe7c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:36.875913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:36.877534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:36.878340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:36.879073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:36.881856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:36.882879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:36.886270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:36.936907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 299/595] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jul 18 08:25:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:36.938849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:37.011271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb700-ed13-4eb9-b348-c221787eb5ff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:37.051567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:37.093108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:37.097214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:37.099329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.100102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.100833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.102648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:37.103484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:37.107419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:37.142215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 297/596] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:37.143470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:37.174964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe7591-7b55-4121-98af-00c7ed2170c0 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:37.254262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:37.256809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.257663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.258465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.279398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:37.282456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:37.318632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:37.320394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:37.322207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:37.322207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:37.322207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:37.322207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:37.326341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 300/597] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:37.328399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:37.355894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc4ad1-c43f-4e62-9e2e-4c5d0e8e0610 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:37.424749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:37.426189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.427457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.427775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.448653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:37.451431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:37.486491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:37.488572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:37.491162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:37.491162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:37.491162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:37.491162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:37.494143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 298/598] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:37.495787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:37.528868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f7f85-142c-4be3-b273-03e5f99dd2f7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:37.553849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:37.566068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:37.578919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd549b71-e9fa-4108-b093-8623f478974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:37.579823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549b71-e9fa-4108-b093-8623f478974d None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.580108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549b71-e9fa-4108-b093-8623f478974d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.580392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549b71-e9fa-4108-b093-8623f478974d None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/df173c85777f45dd8ed9fb11bad366b2/roles/7dd1048f7a5241ea811f20171d0b4bd4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.609059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd549b71-e9fa-4108-b093-8623f478974d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=df173c85777f45dd8ed9fb11bad366b2, role_id=7dd1048f7a5241ea811f20171d0b4bd4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:37.612105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd549b71-e9fa-4108-b093-8623f478974d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:37.650743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78ae22-8db0-4c40-88a5-40a430a59756 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:37.684736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 301/599] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:25:37 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/df173c85777f45dd8ed9fb11bad366b2/roles/7dd1048f7a5241ea811f20171d0b4bd4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:37.686941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818ad1-d3c9-43b3-b751-e8dcdb8e7f2b None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.687553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818ad1-d3c9-43b3-b751-e8dcdb8e7f2b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.688022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818ad1-d3c9-43b3-b751-e8dcdb8e7f2b None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.693941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 302/600] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:37.693941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818ad1-d3c9-43b3-b751-e8dcdb8e7f2b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:37.696083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1c862-2291-4468-a599-e235ece1eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:37.697427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c862-2291-4468-a599-e235ece1eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.698049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c862-2291-4468-a599-e235ece1eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.698642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c862-2291-4468-a599-e235ece1eac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.700184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c862-2291-4468-a599-e235ece1eac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:37.700765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c862-2291-4468-a599-e235ece1eac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:37.703866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c862-2291-4468-a599-e235ece1eac4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:37.731789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 299/601] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:37.734351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718a0f2-85fc-4400-b613-3b0aa810a60c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.734880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718a0f2-85fc-4400-b613-3b0aa810a60c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.735389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718a0f2-85fc-4400-b613-3b0aa810a60c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.741750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 300/602] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:37.741750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67e8e3-4d8b-4ff3-82de-08e373e5a33a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.741750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67e8e3-4d8b-4ff3-82de-08e373e5a33a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.742088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67e8e3-4d8b-4ff3-82de-08e373e5a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.771316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-dd67e8e3-4d8b-4ff3-82de-08e373e5a33a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:37.773010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dd67e8e3-4d8b-4ff3-82de-08e373e5a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:37.893974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 301/603] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:37.893974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67e8e3-4d8b-4ff3-82de-08e373e5a33a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:37.897346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818ad1-d3c9-43b3-b751-e8dcdb8e7f2b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:37.921729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:37.970399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64aeb1-e001-4f47-90da-09d72f9adecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:37.972054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64aeb1-e001-4f47-90da-09d72f9adecf None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.972455 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64aeb1-e001-4f47-90da-09d72f9adecf None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.972899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64aeb1-e001-4f47-90da-09d72f9adecf None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:37.974392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64aeb1-e001-4f47-90da-09d72f9adecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:37.974711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64aeb1-e001-4f47-90da-09d72f9adecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:37.977023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64aeb1-e001-4f47-90da-09d72f9adecf None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:37.991319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 303/604] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:37.992662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632e33-480c-43c3-bca2-d94b2dabce15 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:37.992942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632e33-480c-43c3-bca2-d94b2dabce15 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:37.993226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632e33-480c-43c3-bca2-d94b2dabce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.015596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c4632e33-480c-43c3-bca2-d94b2dabce15 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:38.017246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c4632e33-480c-43c3-bca2-d94b2dabce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:38.051598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67e8e3-4d8b-4ff3-82de-08e373e5a33a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:38.064518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:38.102646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:38.104046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:38.104551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:38.105064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.115288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:38.117604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:38.131216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 304/605] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:38.133027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632e33-480c-43c3-bca2-d94b2dabce15 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:38.155849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:38.157840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:38.159900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:38.161928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 302/606] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:38.164063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.280554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:38.288387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632e33-480c-43c3-bca2-d94b2dabce15 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:38.308512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360521a1-7615-430a-ac42-a20c0f180ad6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:38.339108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:38.340113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:38.340598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:38.341054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.354022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:38.362022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:38.364596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 305/607] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:38.366368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.391186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:38.392265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:38.392559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:38.393006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.398528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:38.403551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:38.405038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:38.420805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:38.422775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 303/608] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:38.423907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.505016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca33a5e-c924-4fc4-894a-89a24416bfc3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:38.557666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:38.558477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:38.558755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:38.559026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.564395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364f1b6-828c-4c36-99c2-3b1eafadcc4e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:38.570794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:38.578809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:38.581018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 306/609] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:38.584102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.617667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:38.618721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:38.619164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:38.619708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.620733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:38.621235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:38.623031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:38.633235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:38.638731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 304/610] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:38.639376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.713458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:38.732930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abe49a-a973-47ca-8722-b3b0b94fa8ba None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:38.758154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e42712-fd16-4e43-9df1-dbe36b523895 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:38.774348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:38.775028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:38.775318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:38.775593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.776369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:38.776678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:38.778113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:38.790363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 307/611] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:38.791267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.810791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:38.811522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:38.811815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:38.812092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:38.812927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:38.813233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:38.814799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:38.838439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 305/612] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:38.838439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:38.919349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:38.966638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414e429-e93c-46a3-9df7-417a5c25429d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:39.015102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:39.015787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.016067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.016342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.017158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:39.017460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:39.019198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:39.027648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8bcc-8944-49fd-8e39-7e6f353dc5d7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:39.033870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 308/613] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:39.036475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:39.053837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:39.082442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:39.084264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.084755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.085227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/b8d2f745ac2a4388a7890250141a4e2a/roles/7dd1048f7a5241ea811f20171d0b4bd4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.112986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=b8d2f745ac2a4388a7890250141a4e2a, role_id=7dd1048f7a5241ea811f20171d0b4bd4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:39.122527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:39.224992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89dd79-8393-43c6-8445-1afb0fc2c02a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:39.251116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 306/614] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:25:38 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/b8d2f745ac2a4388a7890250141a4e2a/roles/7dd1048f7a5241ea811f20171d0b4bd4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:39.253026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:39.280109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:39.281023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.281307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.282062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.309357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:39.311612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:39.369524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:39.370528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:39.371431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:39.371431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:39.371431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:39.371431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:39.391203 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 309/615] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:39.393751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:39.505534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:39.544548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49457-ce40-43ca-9176-1a57a6539bc3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:39.552528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31dbeb-6d28-4cab-838c-d16abb2e531b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:39.569489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:39.589359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:39.590367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.590661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.590940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.603779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:39.605273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:39.622493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:39.624401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.624912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.625494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/b40cb94150444c81ab1de3c6c1c1ed7f/roles/7dd1048f7a5241ea811f20171d0b4bd4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:39.625713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:39.626573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:39.628330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:39.628330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:39.628330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:39.628330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:39.628330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 310/616] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:39.633250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:39.656737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=b40cb94150444c81ab1de3c6c1c1ed7f, role_id=7dd1048f7a5241ea811f20171d0b4bd4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:39.658267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:39.727849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 307/617] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:25:39 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/b40cb94150444c81ab1de3c6c1c1ed7f/roles/7dd1048f7a5241ea811f20171d0b4bd4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:39.730229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:39.789603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e0a60-0813-4149-9311-aa91c65810ad None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:39.816994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:39.858542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edc675-f967-481b-bdb7-0332208d0644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:39.859709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc675-f967-481b-bdb7-0332208d0644 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.860205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc675-f967-481b-bdb7-0332208d0644 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.860698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc675-f967-481b-bdb7-0332208d0644 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.862175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edc675-f967-481b-bdb7-0332208d0644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:39.862975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edc675-f967-481b-bdb7-0332208d0644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:39.866165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edc675-f967-481b-bdb7-0332208d0644 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:39.882342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e4d3-6fe6-417b-b7c4-78e909041414 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:39.891126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 311/618] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:39.893651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6894-4903-4d26-945d-40646e49aa08 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.894182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6894-4903-4d26-945d-40646e49aa08 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.894653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea6894-4903-4d26-945d-40646e49aa08 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.898626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 312/619] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:39.900212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea6894-4903-4d26-945d-40646e49aa08 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:39.930584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e00d8-aa39-4030-9cea-d39f03aca1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:39.932091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e00d8-aa39-4030-9cea-d39f03aca1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.932376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e00d8-aa39-4030-9cea-d39f03aca1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.932534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e00d8-aa39-4030-9cea-d39f03aca1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.933303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e00d8-aa39-4030-9cea-d39f03aca1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:39.933953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e00d8-aa39-4030-9cea-d39f03aca1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:39.935420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e00d8-aa39-4030-9cea-d39f03aca1f0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:39.954119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 308/620] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:39.955957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6448-80fa-446b-85e2-15fe16728716 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:39.956264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6448-80fa-446b-85e2-15fe16728716 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:39.956524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6448-80fa-446b-85e2-15fe16728716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:39.989583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2fac6448-80fa-446b-85e2-15fe16728716 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:39.991379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2fac6448-80fa-446b-85e2-15fe16728716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:40.013590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:40.092196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea6894-4903-4d26-945d-40646e49aa08 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:40.097077 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 309/621] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:40.098061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac6448-80fa-446b-85e2-15fe16728716 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:40.157361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:40.158808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:40.159325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:40.159814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:40.174440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:40.177409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:40.206703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:40.208535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:40.210221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 313/622] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:40.211271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:40.282291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac6448-80fa-446b-85e2-15fe16728716 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:40.290138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:40.350491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:40.352245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:40.352980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:40.353736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:40.369459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:40.372702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:40.392166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bf61b-f840-4ba7-9be0-211d8bc1e6fb None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:40.402189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:40.404049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:40.405964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:40.411355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 310/623] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:40.413251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:40.437397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:40.476245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:40.478089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:40.479345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:40.479910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:40.503217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:40.522137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:40.524283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:40.525784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:40.527053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 314/624] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:40.528873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:40.608803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389471a-a9e1-4451-b086-992224cc40e6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:40.661450 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:40.662308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:40.662642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:40.662993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:40.663953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:40.664333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:40.666108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:40.695976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 311/625] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 08:25:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:40.697504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:40.702056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:40.714542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eba34-1ce8-47cc-87b6-0b02fcd2b651 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:40.765717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:40.766692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:40.767143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:40.767675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:40.768687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:40.769254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:40.771552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:40.796938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 315/626] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 08:25:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:40.798341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:40.827477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:40.895736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6f80-abff-4c07-b278-65c8093f16e3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:40.923522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c915a4-dd30-4a19-824c-97b281ce646d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:40.955068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:40.956427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:40.956969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:40.957563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:40.959814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:40.960390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:40.963241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:40.970005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:40.971034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:40.971523 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:40.972025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:40.979015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 312/627] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:40.980369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:40.997106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:41.085966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:41.088867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:41.147783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e447fac-4f02-46ea-86e9-4ad183055adb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:41.184280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:41.194173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:41.195383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:41.195910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:41.196510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:41.209781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:41.211879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:41.220281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 316/628] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:41.221185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:41.234350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:41.237174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:41.238385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:41.238385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:41.238385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:41.238385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:41.244595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 313/629] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:41.245928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:41.280205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:41.352572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676bd0-af71-4a2d-a981-560cb439464e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:41.366145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa2190-5e8e-4979-bff3-36649d5a1b33 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:41.407254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:41.408530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:41.409057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:41.409556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:41.422751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:41.424018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:41.424530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:41.425043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:41.426076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:41.428651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:41.448325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:41.450096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:41.451011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:41.451933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:41.451933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:41.451933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:41.451933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:41.452156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:41.454285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 314/630] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:41.455478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:41.490287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:41.491359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:41.492376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:41.492376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:41.492376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:41.492376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:41.495481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 317/631] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:41.498516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:41.498886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:41.586344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d2e1b-687e-4e03-a419-1113d9656407 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:41.625991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:41.626522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:41.626809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:41.627189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:41.627815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:41.628170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:41.630147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:41.645986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 315/632] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:41.646511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:41.705788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add42b6-541e-4f34-bfd3-ac6f34b4de0a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:41.709014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:41.765387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:41.771230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25184ca-165d-4e8b-883f-d9ede8ff73f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:41.772390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25184ca-165d-4e8b-883f-d9ede8ff73f9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:41.773024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25184ca-165d-4e8b-883f-d9ede8ff73f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:41.773398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25184ca-165d-4e8b-883f-d9ede8ff73f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:41.774812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25184ca-165d-4e8b-883f-d9ede8ff73f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:41.775370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25184ca-165d-4e8b-883f-d9ede8ff73f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:41.775542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a325-f232-458c-99f1-01918b4159d6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:41.778034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25184ca-165d-4e8b-883f-d9ede8ff73f9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:41.800633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 318/633] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:41.803611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5a71-80b6-452d-be1d-5e3f0a822338 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:41.804117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5a71-80b6-452d-be1d-5e3f0a822338 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:41.804618 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5a71-80b6-452d-be1d-5e3f0a822338 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:41.811178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 319/634] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:41.811178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5a71-80b6-452d-be1d-5e3f0a822338 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:41.828090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:41.828775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:41.829058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:41.829834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:41.830596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:41.830944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:41.833452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:41.869452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 316/635] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:41.869452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:41.980120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5a71-80b6-452d-be1d-5e3f0a822338 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.018314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da51375-0d64-4b84-82a3-246847613339 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.021823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720042d2-0430-4baf-bd4d-08a6dc2e9d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.023011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720042d2-0430-4baf-bd4d-08a6dc2e9d43 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.023298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720042d2-0430-4baf-bd4d-08a6dc2e9d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.023568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720042d2-0430-4baf-bd4d-08a6dc2e9d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.032040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720042d2-0430-4baf-bd4d-08a6dc2e9d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.033654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720042d2-0430-4baf-bd4d-08a6dc2e9d43 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-720042d2-0430-4baf-bd4d-08a6dc2e9d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:42.050160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:42.051698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:42.052749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 320/636] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:42.053780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296bfdc-a645-400a-898f-0e1c9c1f508b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.053780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296bfdc-a645-400a-898f-0e1c9c1f508b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.053958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296bfdc-a645-400a-898f-0e1c9c1f508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.076848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2296bfdc-a645-400a-898f-0e1c9c1f508b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:42.078224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2296bfdc-a645-400a-898f-0e1c9c1f508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:42.079304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.080693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.081186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.081698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.095720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.099186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.101545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:42.118799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:42.121375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 317/637] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:42.122380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.147389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:42.181784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 321/638] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:42.181784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296bfdc-a645-400a-898f-0e1c9c1f508b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.296333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d0254-e2ad-4f7b-b7b9-f3dc568598b7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.316517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296bfdc-a645-400a-898f-0e1c9c1f508b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.343706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.344500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.344798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.345457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.355608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.357080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.366381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.367484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.367960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.368445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.369790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:42.370136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.371637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:42.373567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:42.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 318/639] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:42.376281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.394121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 322/640] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:42.396072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.427660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:42.468550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:42.501792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62792341-1012-4265-888b-ef62fc9f3579 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.539239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c1b44-0b32-498e-a238-ff2aa52e9ac2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.548178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.548780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.549060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.549337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.550167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:42.550474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.552510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.565108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 319/641] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:42.566010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.597161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.598909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.598909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.599205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.611107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:42.620292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:42.621462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:42.622429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 323/642] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:42.623144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.706615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfc73c-1dca-4082-819b-21c29fee3e83 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.707953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:42.738596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:42.745914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c76b-7ba4-4369-a3ad-b802c04ecc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.746800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c76b-7ba4-4369-a3ad-b802c04ecc65 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.747134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c76b-7ba4-4369-a3ad-b802c04ecc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.747417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c76b-7ba4-4369-a3ad-b802c04ecc65 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.748554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c76b-7ba4-4369-a3ad-b802c04ecc65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:42.748897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c76b-7ba4-4369-a3ad-b802c04ecc65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.750893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c76b-7ba4-4369-a3ad-b802c04ecc65 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.751403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52eff1-1e52-4d8a-8188-43494fdf1c53 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.775223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 320/643] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:42.777296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c7a9e-1d9b-4b19-842b-6be66db16d07 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.777805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c7a9e-1d9b-4b19-842b-6be66db16d07 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.778295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c7a9e-1d9b-4b19-842b-6be66db16d07 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.780684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 321/644] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:42.781985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c7a9e-1d9b-4b19-842b-6be66db16d07 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.799274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.800329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.800684 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.801033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/083f9aa9e5d84adbb8a82f1b0addd788/roles/7dd1048f7a5241ea811f20171d0b4bd4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.823261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=083f9aa9e5d84adbb8a82f1b0addd788, role_id=7dd1048f7a5241ea811f20171d0b4bd4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.825527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.903704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 324/645] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:25:42 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/083f9aa9e5d84adbb8a82f1b0addd788/roles/7dd1048f7a5241ea811f20171d0b4bd4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:25:42.904875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:42.911573 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c7a9e-1d9b-4b19-842b-6be66db16d07 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:42.967949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:42.969061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:42.969547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:42.970005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:42.971391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=ec22f82d0e7745f282c5837459fba05e) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:42.971870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:42.974967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:42.985527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 322/646] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/role_assignments?user.id=ec22f82d0e7745f282c5837459fba05e&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:42.987060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:43.087643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7f82-4a2d-4fd7-882e-83e4b75bb537 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:43.103907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:43.122347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:43.138888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57048b25-e1a9-4bd0-afa5-990476c6daf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:43.139967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57048b25-e1a9-4bd0-afa5-990476c6daf0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.140443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57048b25-e1a9-4bd0-afa5-990476c6daf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.140931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57048b25-e1a9-4bd0-afa5-990476c6daf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.142679 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57048b25-e1a9-4bd0-afa5-990476c6daf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:43.143242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57048b25-e1a9-4bd0-afa5-990476c6daf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:43.146430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57048b25-e1a9-4bd0-afa5-990476c6daf0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:43.158831 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 325/647] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:43.160725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc666-0927-4940-a92d-9247309b6a94 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.161307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc666-0927-4940-a92d-9247309b6a94 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.161870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc666-0927-4940-a92d-9247309b6a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.183567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-9fbcc666-0927-4940-a92d-9247309b6a94 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:43.184899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9fbcc666-0927-4940-a92d-9247309b6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:43.194517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d683b-7f07-4d67-9782-456c32448b0f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:43.266454 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:43.267609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.268115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.268586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.295185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 326/648] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:43.296803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc666-0927-4940-a92d-9247309b6a94 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:43.397109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:43.398650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:43.478029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:43.483471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc666-0927-4940-a92d-9247309b6a94 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:43.511853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:43.558600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:43.560507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.561217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.562231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.570795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 323/649] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:43.572591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:43.592193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:43.593716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:43.615234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:43.616466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:43.617460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:43.617460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:43.617460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:43.617460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:43.617460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 327/650] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:43.618018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:43.714842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b57f9c-9467-4441-9439-d295c23250a0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:43.732268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8eedf-f1c3-4ac9-ae09-d85ed21e4e42 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:43.755010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:43.756082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.756539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.756959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.770698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:43.770904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:43.771922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.772207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.772482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:43.779978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:43.781127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:43.782120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:43.783877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:43.789631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:43.790138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 324/651] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:43.791318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:43.810160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:43.810544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:43.811864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:43.813974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:43.813974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:43.813974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:43.813974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:43.813974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 328/652] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:43.814623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:43.836484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:43.926500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edff20-33ad-4b38-8fdf-180d79d30549 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:43.933650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dd0b8-b02f-4e0d-81f4-690a93f6fcce None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:43.972512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:43.974383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.974915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.975432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.976330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:43.976878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:43.977300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:43.978021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:43.978305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:43.978577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:43.979170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:43.979381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:43.979633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:43.981035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:43.996639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 329/653] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:43.996639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.002488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 325/654] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:44.003703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.091745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:44.102361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:44.115231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807cae3-1301-47db-87f9-cc1c8dfcc439 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.133236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f9aed-0c9d-48fb-b6a3-44cb7f08cd27 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.156056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.156740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.157023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.157299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.158077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:44.158380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.159791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.173814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 330/655] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:44.174905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.176421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.177447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.178025 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.178449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.191282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.193666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:44.214670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:44.215823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:44.216848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:44.216848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:44.216848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:44.216848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:44.229855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 326/656] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:44.229855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.302851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321164b3-f234-4c58-a3ac-c7f6f3dfa25b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.352420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.354254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.354672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.355055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.358053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3fd3f-583a-40bc-88ad-d7ed1a500a53 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.366689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.368365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.372494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:44.391148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:44.392182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:44.393128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 331/657] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:44.394526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.399358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:44.414971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.416146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.416499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.416852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.427991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.431033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:44.452436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:44.453415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:44.454697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 327/658] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:44.455181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.530637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce3b7e-2f7a-428d-ae6a-2811cccdf87d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.577011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.577715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.578040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.578321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.579073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:44.579384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.580796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.595039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 332/659] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:44.595959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.611701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f06ed-b15c-45e4-ab89-f6f35c8adaa7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.655798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.656538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.656834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.657115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.658041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:44.658357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.659835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.679178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:44.685998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 328/660] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:44.687000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.742164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4d0a-04a6-4dd6-baa7-bcc1deb6b7f2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.743968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:44.794459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.796117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.796578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.797002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.798260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:44.799188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.802030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.808467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aea2f-cd56-48ac-a806-05f11159103a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.822212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 333/661] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:44.823223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.858982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:44.860517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:44.861014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:44.861498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:44.872683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:44.875269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:44.893486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:44.894556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 329/662] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:44.896756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:44.963272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9147e-1e3f-420e-b9c9-8f9c2c69b173 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:44.996189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:45.016323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de79e87-1f15-4eb6-8b8b-0efa4613a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:45.016999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79e87-1f15-4eb6-8b8b-0efa4613a15d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.017288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79e87-1f15-4eb6-8b8b-0efa4613a15d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.017570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79e87-1f15-4eb6-8b8b-0efa4613a15d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.018548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ee599-ab87-4bae-83ed-4107e1a0d648 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:45.023779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:45.071288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:45.072767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.073302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.074075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.075171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=df173c85777f45dd8ed9fb11bad366b2) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:45.076028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:45.078632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:45.088901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 330/663] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/role_assignments?user.id=df173c85777f45dd8ed9fb11bad366b2&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:45.090184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:45.121237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de79e87-1f15-4eb6-8b8b-0efa4613a15d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:45.123084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de79e87-1f15-4eb6-8b8b-0efa4613a15d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:45.232221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b108d-6d3a-47bf-a8c3-9b9002428706 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:45.280261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec6cd-d0c4-4b17-ad9f-9d31866fac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:45.280966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec6cd-d0c4-4b17-ad9f-9d31866fac80 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.281277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec6cd-d0c4-4b17-ad9f-9d31866fac80 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.281530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec6cd-d0c4-4b17-ad9f-9d31866fac80 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.282441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ec6cd-d0c4-4b17-ad9f-9d31866fac80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:45.282756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ec6cd-d0c4-4b17-ad9f-9d31866fac80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:45.284265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ec6cd-d0c4-4b17-ad9f-9d31866fac80 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:45.311569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 331/664] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jul 18 08:25:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:45.313624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b0d2b-b0e9-4c06-9d36-38e689ee7d84 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.314237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b0d2b-b0e9-4c06-9d36-38e689ee7d84 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.314716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b0d2b-b0e9-4c06-9d36-38e689ee7d84 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.321285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 332/665] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:45.322623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b0d2b-b0e9-4c06-9d36-38e689ee7d84 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:45.347005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 334/666] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:45.349226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74112fa-071a-45fc-b22e-c7fa2403a45a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.349515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74112fa-071a-45fc-b22e-c7fa2403a45a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.349853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74112fa-071a-45fc-b22e-c7fa2403a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.363518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:45.371885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a74112fa-071a-45fc-b22e-c7fa2403a45a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:45.373116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a74112fa-071a-45fc-b22e-c7fa2403a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:45.390872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:45.467783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b0d2b-b0e9-4c06-9d36-38e689ee7d84 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:45.469512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 335/667] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:45.470470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74112fa-071a-45fc-b22e-c7fa2403a45a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:45.515098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:45.515863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.516213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.516581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.609906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:45.611774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:45.620644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74112fa-071a-45fc-b22e-c7fa2403a45a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:45.651734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:45.667616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:45.669465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.670004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.670472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.687014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:45.689601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:45.715021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:45.716194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:45.717319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:45.717319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:45.717319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:45.717319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:45.724259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 336/668] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:45.724259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:45.730081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:45.756566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 333/669] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:45.757817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:45.861166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797bdc8-a163-4ce1-ae32-4eab92ecc0db None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:45.902744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:45.903818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.904288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.904734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.917962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:45.921098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13802cea-8048-47ae-b8fa-ed60b02cfea4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:45.926116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:45.927968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 337/670] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:45.929637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:45.965787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:45.981409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1fe8a-f019-4b30-a43e-12ff8bff5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:45.982609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1fe8a-f019-4b30-a43e-12ff8bff5782 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:45.983117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1fe8a-f019-4b30-a43e-12ff8bff5782 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:45.983607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1fe8a-f019-4b30-a43e-12ff8bff5782 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:45.985230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1fe8a-f019-4b30-a43e-12ff8bff5782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:45.985811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1fe8a-f019-4b30-a43e-12ff8bff5782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:45.988684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1fe8a-f019-4b30-a43e-12ff8bff5782 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.001002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:46.009308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 334/671] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:46.009308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0309c7-f881-41c4-83aa-14b9b2af0ac7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.009308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0309c7-f881-41c4-83aa-14b9b2af0ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.009308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0309c7-f881-41c4-83aa-14b9b2af0ac7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.016480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 335/672] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:46.017389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0309c7-f881-41c4-83aa-14b9b2af0ac7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:46.063303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131ca61-83cb-4682-b9d1-99efda667fcf None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:46.104248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:46.105985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.106518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.106979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.125964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:46.129767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:46.165789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:46.166828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:46.167868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:46.167868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:46.167868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:46.167868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:46.168116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 338/673] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:46.169490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:46.176987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0309c7-f881-41c4-83aa-14b9b2af0ac7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:46.229892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b8ac-3625-46aa-b4d0-fde4fedf4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:46.231350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b8ac-3625-46aa-b4d0-fde4fedf4861 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.231868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b8ac-3625-46aa-b4d0-fde4fedf4861 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.232367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b8ac-3625-46aa-b4d0-fde4fedf4861 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.233600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b8ac-3625-46aa-b4d0-fde4fedf4861 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:46.234194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b8ac-3625-46aa-b4d0-fde4fedf4861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:46.237563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b8ac-3625-46aa-b4d0-fde4fedf4861 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.254850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 336/674] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:46.257446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bef31-2507-41f0-a43c-3e2e2b40a361 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.257990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bef31-2507-41f0-a43c-3e2e2b40a361 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.258484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bef31-2507-41f0-a43c-3e2e2b40a361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.291291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4a0bef31-2507-41f0-a43c-3e2e2b40a361 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:46.293409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4a0bef31-2507-41f0-a43c-3e2e2b40a361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:46.315040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cd48e-3830-4ad4-a6a7-aa38485bc52c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:46.332283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:46.356070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:46.356878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.357155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.357429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.366004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:46.367486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.377971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:46.385063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:46.388559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:46.389456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:46.391177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 339/675] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:46.392104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:46.425760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 337/676] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:46.425760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bef31-2507-41f0-a43c-3e2e2b40a361 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:46.528513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fdb8c-1ec5-4243-ae70-fa2b3ed07fbb None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:46.585501 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:46.586485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.587006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.587447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.588331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:46.588851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:46.590724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.593117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bef31-2507-41f0-a43c-3e2e2b40a361 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:46.609607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 340/677] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:46.611711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:46.651566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:46.652729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.653196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.653733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.671466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:46.672974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.680142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:46.693282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:46.694604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:46.696372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:46.696372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:46.696372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:46.696372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:46.696372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 338/678] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:46.696372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:46.742201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:46.785142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0120b-0468-47bd-baba-b3062445458c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:46.844210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:46.845369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.845947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.846509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.848481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:46.849107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:46.851771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.854362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f0109-c18d-4f10-9854-93978906ac30 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:46.878522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 341/679] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:46.878522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:46.915799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:46.916991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:46.917282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:46.917557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:46.935864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:46.938639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:46.965411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:46.966449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:46.972411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:46.972411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:46.972411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:46.972411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:46.972411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 339/680] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:46.972411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:47.011350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:47.021755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668574d-f28b-4310-8e0c-ae92de485fa3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.074115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:47.090082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.091435 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.091984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.092478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.094110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd38b3-4b9f-4494-909e-913ee49716ca None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.106132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.108876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:47.126297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:47.128036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 342/681] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:47.129757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:47.144202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.145778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.146483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.147014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.148432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:47.149092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.151482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.177722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 340/682] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:47.177722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:47.281020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667a6ab-d934-41bd-98b3-7eff81ca0854 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.329597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.330331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.330611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.330888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.331758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=b8d2f745ac2a4388a7890250141a4e2a) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:47.332172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.334091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.337339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1746ba-88c6-4095-93bd-22754afcb23e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.344094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 343/683] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:47 2022] GET /identity/v3/role_assignments?user.id=b8d2f745ac2a4388a7890250141a4e2a&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:47.344094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:47.374442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:47.431885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.432640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.432809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.433083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.433789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:47.434091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.435521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.457780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 341/684] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:47.459270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:47.462747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:47.531854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbc6b1-a16c-4d60-b41e-185e8d59763d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.587441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.588287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.588597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.588951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.589857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:47.590325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.594038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.618429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 344/685] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:47.619830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:47.635211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019f63-9bfa-47cf-b309-68a9c878ae08 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.706932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.709011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.709579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.710195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.725589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.728566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:47.760756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:47.762729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:47.764572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 342/686] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:47.765817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:47.810715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:47.853509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defd7ae-d42d-4db6-be56-cda7cd9fb498 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.887259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:47.930944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f530b2b-8145-4b13-a100-3560e6ea29a3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:47.933884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.935300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.936018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.936729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.938342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.942276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.969906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:47.970688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:47.971085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:47.971586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:47.972583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=b40cb94150444c81ab1de3c6c1c1ed7f) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:47.973022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:47.974636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:47.982779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 343/687] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:47 2022] GET /identity/v3/role_assignments?user.id=b40cb94150444c81ab1de3c6c1c1ed7f&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:47.983800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:48.065788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 345/688] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:25:47 2022] POST /identity/v3/users => generated 254 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:25:48.215736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e8bde-1bfb-40ba-9a5c-71b00a1f1d59 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:48.272008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:48.289929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d1bc5-8881-4365-93a8-1ba064d97584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:48.291542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d1bc5-8881-4365-93a8-1ba064d97584 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:48.292325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d1bc5-8881-4365-93a8-1ba064d97584 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:48.293068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d1bc5-8881-4365-93a8-1ba064d97584 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:48.295236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d1bc5-8881-4365-93a8-1ba064d97584 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:48.296128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d1bc5-8881-4365-93a8-1ba064d97584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:48.299239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d1bc5-8881-4365-93a8-1ba064d97584 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:48.339774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 344/689] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 08:25:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:48.345967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:48.454976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993bde-2367-4206-a624-ea7790223ae0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:48.455470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993bde-2367-4206-a624-ea7790223ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:48.455966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993bde-2367-4206-a624-ea7790223ae0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:48.461486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 345/690] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:25:48.466970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660603b-368c-41a9-a81a-014fa997b833 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:48.467253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660603b-368c-41a9-a81a-014fa997b833 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:48.467526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660603b-368c-41a9-a81a-014fa997b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:48.505555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6660603b-368c-41a9-a81a-014fa997b833 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:48.507878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6660603b-368c-41a9-a81a-014fa997b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:48.559546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07e39-e8d0-4112-b97d-697525e043ce None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:48.630870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:48.632000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:48.632486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:48.632956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:48.638041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:48.670596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 346/691] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:48.697624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660603b-368c-41a9-a81a-014fa997b833 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:48.774500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:48.777244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:48.961829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 346/692] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:48.963628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:49.004097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660603b-368c-41a9-a81a-014fa997b833 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:49.036806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:49.072642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:49.087041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:49.089107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:49.089710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:49.090231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:49.116840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:49.135817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:49.137714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:49.139342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:49.140197 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 347/693] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:49.148805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:49.234050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13328cbd-40af-4da1-8999-4e49af3220e7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:49.314941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:49.315802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:49.316290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:49.321708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:49.351093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:49.354156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:49.387717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842103cb-2703-43d3-9c70-c5d924796d4f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:49.406970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:49.408751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:49.411474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:49.411474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:49.411474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:49.411474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:49.411474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 347/694] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:49.419739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:49.536022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:49.536742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:49.536742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:49.537210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:49.541712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:49.541712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:49.541712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:49.562877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 348/695] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:49.571517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:49.621582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:49.640593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace152f7-c110-4258-a597-df45b82dddaf None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:49.695744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:49.700497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:49.706442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:49.708426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:49.708426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:49.709049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:49.709536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:49.711203 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:49.749514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 348/696] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:49.758448 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:49.807402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2687f9b-d1dd-4dc6-9966-c02c33318564 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:49.946279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:49.947516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:49.947995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:49.948465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:49.985354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:49.988933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:50.057244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:50.058279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:50.059183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:50.059183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:50.059183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:50.059183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:50.063528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 349/697] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:50.068230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacc8a9-f93a-4210-ac3f-54882a815f42 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:50.069743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:50.170001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:50.171345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:50.171784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:50.172222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:50.203971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:50.206888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:50.249995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:50.250992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:50.251888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:50.252789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 349/698] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:50.267260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:50.299075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:50.326614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:50.350425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de74f68-6ef5-48e3-a391-5153ffaaa91b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:50.449475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:50.450627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:50.451137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:50.451637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:50.453180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:50.453851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:50.456699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:50.490143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 350/699] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:50.494267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:50.679884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf4d8-d8d8-4ae6-91b3-efa0d0d5eb91 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:50.777210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4f040-a656-42b2-8d12-9902f536077b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:50.792028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:50.793191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:50.793712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:50.794215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:50.795986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:50.796303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:50.799068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:50.836412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 350/700] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 570 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:50.850460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:50.858537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15d253-4da7-422f-81a9-115d1dea0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:50.859906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15d253-4da7-422f-81a9-115d1dea0257 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:50.860421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15d253-4da7-422f-81a9-115d1dea0257 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:50.860918 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15d253-4da7-422f-81a9-115d1dea0257 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:50.888946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15d253-4da7-422f-81a9-115d1dea0257 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:50.891603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15d253-4da7-422f-81a9-115d1dea0257 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fa15d253-4da7-422f-81a9-115d1dea0257 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:50.924755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:50.926756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:50.928750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:50.931077 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 351/701] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:25:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:50.934020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a59fb-7188-4b00-9dda-9892e9974134 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:50.934545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a59fb-7188-4b00-9dda-9892e9974134 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:50.935048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a59fb-7188-4b00-9dda-9892e9974134 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:50.937897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 352/702] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:50.939033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a59fb-7188-4b00-9dda-9892e9974134 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:50.976048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:51.018254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:51.086514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310614c8-55fa-4a2b-be15-441ceba308a8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:51.162220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ff537-e84e-4480-8185-33f45995e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:51.163157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ff537-e84e-4480-8185-33f45995e3cd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:51.163664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ff537-e84e-4480-8185-33f45995e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:51.164163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ff537-e84e-4480-8185-33f45995e3cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:51.165825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ff537-e84e-4480-8185-33f45995e3cd None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=083f9aa9e5d84adbb8a82f1b0addd788) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:51.166403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ff537-e84e-4480-8185-33f45995e3cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:51.169498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ff537-e84e-4480-8185-33f45995e3cd None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:51.176661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a59fb-7188-4b00-9dda-9892e9974134 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:51.182819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 351/703] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:50 2022] GET /identity/v3/role_assignments?user.id=083f9aa9e5d84adbb8a82f1b0addd788&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:51.184993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9106d-dfab-4251-a7fe-8a0f3a5955ad None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:51.185499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9106d-dfab-4251-a7fe-8a0f3a5955ad None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:51.186020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9106d-dfab-4251-a7fe-8a0f3a5955ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:51.216892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-97a9106d-dfab-4251-a7fe-8a0f3a5955ad None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:51.219059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-97a9106d-dfab-4251-a7fe-8a0f3a5955ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:51.250002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:51.251567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:51.252351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:51.253179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:51.255197 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:51.256037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:51.259223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:51.314220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 353/704] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:25:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:51.323771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:51.360693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 352/705] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:51.401976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9106d-dfab-4251-a7fe-8a0f3a5955ad None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:51.457715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:51.532418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:51.570561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a1d4-c724-4312-8696-32fcb9aee692 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:51.620349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9106d-dfab-4251-a7fe-8a0f3a5955ad None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:51.633391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:51.634459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:51.634992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:51.635485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:51.695752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:51.697134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:51.697641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:51.699801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:51.700907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:51.703845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:51.720419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:51.723026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:51.735765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:51.736828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:25:51.737978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:51.739997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 353/706] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jul 18 08:25:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:51.749977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:51.809265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:51.854291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 354/707] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:51.866808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:51.967080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493e22c-2294-431a-ac8b-78619995e443 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.000099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef037-a90c-4e7e-a242-0ba8df3c3b44 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.010919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:52.023973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536be07-e0e3-4c79-b84f-212cfc98bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:52.028184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536be07-e0e3-4c79-b84f-212cfc98bca4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.028184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536be07-e0e3-4c79-b84f-212cfc98bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.028184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536be07-e0e3-4c79-b84f-212cfc98bca4 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.028184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536be07-e0e3-4c79-b84f-212cfc98bca4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:52.028184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536be07-e0e3-4c79-b84f-212cfc98bca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:52.028184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536be07-e0e3-4c79-b84f-212cfc98bca4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:52.033581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 354/708] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 08:25:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:52.038685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb0df-37f9-4fc1-b911-520550d08dc4 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.039062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb0df-37f9-4fc1-b911-520550d08dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.039310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb0df-37f9-4fc1-b911-520550d08dc4 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.040444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620c06-0c88-489c-81ed-846bd73ea8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:52.041259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620c06-0c88-489c-81ed-846bd73ea8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.041540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620c06-0c88-489c-81ed-846bd73ea8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.041856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620c06-0c88-489c-81ed-846bd73ea8f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.045094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 355/709] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:52.046302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb0df-37f9-4fc1-b911-520550d08dc4 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:52.057314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620c06-0c88-489c-81ed-846bd73ea8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:52.058831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620c06-0c88-489c-81ed-846bd73ea8f5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-35620c06-0c88-489c-81ed-846bd73ea8f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:52.079195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:52.080977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 355/710] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902beef2-efb5-4b6c-9af7-e05fa7a03ae3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902beef2-efb5-4b6c-9af7-e05fa7a03ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.083361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902beef2-efb5-4b6c-9af7-e05fa7a03ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.101929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-902beef2-efb5-4b6c-9af7-e05fa7a03ae3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:52.103169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-902beef2-efb5-4b6c-9af7-e05fa7a03ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:52.125723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:52.183218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb0df-37f9-4fc1-b911-520550d08dc4 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.191993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 356/711] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:52.192866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902beef2-efb5-4b6c-9af7-e05fa7a03ae3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:52.245364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc455d0-c2d1-4116-8b1e-cd827e2c5b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:52.246628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc455d0-c2d1-4116-8b1e-cd827e2c5b96 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.247132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc455d0-c2d1-4116-8b1e-cd827e2c5b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.247626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc455d0-c2d1-4116-8b1e-cd827e2c5b96 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.248982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc455d0-c2d1-4116-8b1e-cd827e2c5b96 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:52.249535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc455d0-c2d1-4116-8b1e-cd827e2c5b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:52.252225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc455d0-c2d1-4116-8b1e-cd827e2c5b96 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:52.270017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 356/712] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 08:25:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:52.270017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725f547-f05e-4592-8cbb-4bf3796a5cc3 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.270017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725f547-f05e-4592-8cbb-4bf3796a5cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.270017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725f547-f05e-4592-8cbb-4bf3796a5cc3 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.270017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 357/713] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:52.270939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725f547-f05e-4592-8cbb-4bf3796a5cc3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:52.335975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902beef2-efb5-4b6c-9af7-e05fa7a03ae3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.373297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:52.404623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeeb5e-2c68-4d5b-a14b-ad28353e31ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:52.405384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeeb5e-2c68-4d5b-a14b-ad28353e31ce None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.405695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeeb5e-2c68-4d5b-a14b-ad28353e31ce None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.406103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeeb5e-2c68-4d5b-a14b-ad28353e31ce None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.406912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeeb5e-2c68-4d5b-a14b-ad28353e31ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:52.407229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeeb5e-2c68-4d5b-a14b-ad28353e31ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:52.408666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeeb5e-2c68-4d5b-a14b-ad28353e31ce None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:52.428746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 357/714] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:52.430832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690be5-3005-4066-8e34-27ccb42a61f1 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.431132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690be5-3005-4066-8e34-27ccb42a61f1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.431424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690be5-3005-4066-8e34-27ccb42a61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.454664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4a690be5-3005-4066-8e34-27ccb42a61f1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:52.454986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4a690be5-3005-4066-8e34-27ccb42a61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:52.458580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:52.472877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725f547-f05e-4592-8cbb-4bf3796a5cc3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.544717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:52.546079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.546554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.547049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] PATH_INFO: `/v3/services/network` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.548284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:52.548822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 358/715] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:52.551671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:52.554024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690be5-3005-4066-8e34-27ccb42a61f1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:52.576246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:52.577362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:25:52.578281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:52.579171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 358/716] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:52 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:52.586508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:52.730829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690be5-3005-4066-8e34-27ccb42a61f1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.755850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9613ad-11e4-4e84-89fa-096c1b3d6489 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.776378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:52.777320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.779470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.779982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.792531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:52.795904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:52.797732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:52.800303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:52.817870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:52.818978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:52.819884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:52.823073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 359/717] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:52.824226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:52.829736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:52.832374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:52.832374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:52.832948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:52.834494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] RBAC: Adding query filter params (name=network) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:52.835146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:52.838464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:52.846776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 359/718] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:25:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:52.850538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:52.950837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0a561-6af3-4d30-8dfa-90810ff4a167 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:52.965807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa707ec-ad72-4acc-8a26-cae5e0e2200b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:53.000739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:53.001572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:53.001894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:53.002170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:53.013465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:53.014902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:53.015022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:53.015540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:53.016038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:53.017057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:53.017593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:53.019515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:53.023220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:53.024188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:25:53.025114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:53.029789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 360/719] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:53.030761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:53.040276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 360/720] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:53.041629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:53.094592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:53.114302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:53.163889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0a875-39f9-44df-af3b-a0f211380f27 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:53.164529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1ad67-9245-49f6-9add-cb6d2cd3d1c7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:53.208225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:53.209006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:53.209364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:53.209734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:53.210861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:53.211246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:53.212720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:53.225806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 361/721] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:25:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:53.225806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:53.231908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:53.232997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:53.233581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:53.238923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:53.240547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:53.241328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:53.248325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:53.276855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 361/722] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:53.283669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:53.362720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332de8-1ea1-4184-876d-b133ef43eba5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:53.398069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:53.411226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:53.412537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:53.413013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:53.413502 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:53.415029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=df173c85777f45dd8ed9fb11bad366b2) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:53.415552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:53.417435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:53.425132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 362/723] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:53 2022] GET /identity/v3/role_assignments?user.id=df173c85777f45dd8ed9fb11bad366b2&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:53.567029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438b89-2c7b-41ee-9bf8-e27f571a9a5d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:53.569283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:53.621976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:53.622834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:53.623132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:53.623413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:53.637292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:53.638847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:53.660568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:53.661534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:53.662551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:53.662551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:53.662551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:53.662551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:53.666582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 362/724] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:53.672219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:53.807389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3294fe-01b1-4151-ab8e-bf403e7b4631 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:53.857930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:53.858978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:53.859474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:53.859955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:53.860931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:53.861476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:53.867313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:53.885891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 363/725] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:53.892571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:54.101144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a07b-c9da-4a23-83bb-dedbe5821a7d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:54.179763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:54.180994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:54.181452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:54.181975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:54.197969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:54.200700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:54.233228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:54.234762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:25:54.235777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:54.239488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 363/726] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:25:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:54.244966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:54.343937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:54.423833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f696a3-95ea-4ad8-80dd-3b39cf4fa3ac None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:54.466327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e9a12-05de-492a-94f0-641af5be787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:54.467408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e9a12-05de-492a-94f0-641af5be787e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:54.467930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e9a12-05de-492a-94f0-641af5be787e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:54.468440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e9a12-05de-492a-94f0-641af5be787e None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:54.469542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e9a12-05de-492a-94f0-641af5be787e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:54.470113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e9a12-05de-492a-94f0-641af5be787e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:54.471817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e9a12-05de-492a-94f0-641af5be787e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:54.495024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 364/727] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 08:25:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:54.503533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:54.558243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:54.764751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea12008-95da-429b-9a41-66ce5cf7b3f7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:54.853138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:54.854269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:54.854752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:54.855222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.032501 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:55.034015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:55.051822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:55.069165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75cc1-ca95-4ada-818b-0c318aac8eb5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:55.070135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75cc1-ca95-4ada-818b-0c318aac8eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:55.070586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75cc1-ca95-4ada-818b-0c318aac8eb5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.072572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 365/728] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:55.078458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ebca8-d60e-4efe-ae33-0923e6e21d24 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:55.079085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ebca8-d60e-4efe-ae33-0923e6e21d24 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:55.079568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ebca8-d60e-4efe-ae33-0923e6e21d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.098613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8c1ebca8-d60e-4efe-ae33-0923e6e21d24 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:55.100266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c1ebca8-d60e-4efe-ae33-0923e6e21d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:55.178563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 366/729] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:25:55.185705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e091e3-2b53-4364-aab6-9af79586e561 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:55.185992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 364/730] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 08:25:55.189729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e091e3-2b53-4364-aab6-9af79586e561 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:55.189729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e091e3-2b53-4364-aab6-9af79586e561 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.189729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 367/731] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:55.196950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:55.197157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d609c2-ffb5-4217-8922-2434094b1dbc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:55.197356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d609c2-ffb5-4217-8922-2434094b1dbc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:55.197640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d609c2-ffb5-4217-8922-2434094b1dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.225512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a9d609c2-ffb5-4217-8922-2434094b1dbc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:55.227167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a9d609c2-ffb5-4217-8922-2434094b1dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:55.275773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:55.329823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 368/732] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 08:25:55.330758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d609c2-ffb5-4217-8922-2434094b1dbc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:55.347005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60798498-2bf5-4cc2-bff2-93d70ea91440 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:55.366583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:55.391154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:55.392592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:55.393657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:55.394251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.412057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:55.413961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:55.433566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:55.434543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:55.435453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:55.435453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:55.435453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:55.435453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:55.437784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 365/733] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:55.438956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:55.473796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d609c2-ffb5-4217-8922-2434094b1dbc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:55.514301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:55.515379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:55.515914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:55.516412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.517418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:55.525888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:55.577087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc0082-26bd-46a3-a104-a141d7772258 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:55.619044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:55.619776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:55.620059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:55.620340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:55.638602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:55.650294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 369/734] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:25:55 2022] POST /identity/v3/services => generated 251 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:25:55.652498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:55.654444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:55.656237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:55.658608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 366/735] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:55.664592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:55.762827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:55.775966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:55.988449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf563468-21b5-4805-9b1c-948a313583fe None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:55.999102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665229c-605a-44cf-b95e-c7325d407d00 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:56.059896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:56.060132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:56.061061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.061267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.061572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.061938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.062059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.063338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.063468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:56.064011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:56.064607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:56.065107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:56.066916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:56.068674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:56.083429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 370/736] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:56.084055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 367/737] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:25:56.093835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:56.094724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:56.195626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:56.259490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f82b1-4ec6-4ec8-997c-1e34108c7476 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:56.378225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:56.388518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d36614-ae9b-4a15-b868-5bda5ec4ace7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:56.408578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec837a-8421-4b82-bd93-85b3752071ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:56.409417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec837a-8421-4b82-bd93-85b3752071ec None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.409775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec837a-8421-4b82-bd93-85b3752071ec None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.410047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec837a-8421-4b82-bd93-85b3752071ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.424801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec837a-8421-4b82-bd93-85b3752071ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:56.426867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec837a-8421-4b82-bd93-85b3752071ec None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:56.452715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d9577-db96-4d38-aee7-62e093bf5a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:56.453521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9577-db96-4d38-aee7-62e093bf5a0d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.453843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9577-db96-4d38-aee7-62e093bf5a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.454126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9577-db96-4d38-aee7-62e093bf5a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.466865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d9577-db96-4d38-aee7-62e093bf5a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8cec837a-8421-4b82-bd93-85b3752071ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:56.467939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:56.469518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:56.471251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:56.472067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d9577-db96-4d38-aee7-62e093bf5a0d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:56.473946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 371/738] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:56.477132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633a984-0d91-4b4e-8baa-897d04ec7436 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.478156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633a984-0d91-4b4e-8baa-897d04ec7436 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.478970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633a984-0d91-4b4e-8baa-897d04ec7436 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.489229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 372/739] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:56.491412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633a984-0d91-4b4e-8baa-897d04ec7436 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-409d9577-db96-4d38-aee7-62e093bf5a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:56.496730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:56.498525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:56.500290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:56.500290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:56.500290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:56.500290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:56.504518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 368/740] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:56.505290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2299-4a1c-4d66-9bc4-17b417ba446f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.505585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2299-4a1c-4d66-9bc4-17b417ba446f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.505947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2299-4a1c-4d66-9bc4-17b417ba446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.527655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8a6f2299-4a1c-4d66-9bc4-17b417ba446f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:56.528808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8a6f2299-4a1c-4d66-9bc4-17b417ba446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:56.639476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 369/741] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 08:25:56.639476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2299-4a1c-4d66-9bc4-17b417ba446f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:56.716536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633a984-0d91-4b4e-8baa-897d04ec7436 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:56.759209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:56.759631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.759919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.760194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.761023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:56.761338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:56.762895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:56.774224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:56.780846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:56.788685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 373/742] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:56.794297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:56.817618 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2299-4a1c-4d66-9bc4-17b417ba446f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:56.866626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:56.868343 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:56.868847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:56.869356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:56.870497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:56.871573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:56.873220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:56.889587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 370/743] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:56.890815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:56.983134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e1704-c816-42c1-a107-83b0c4e14b32 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:57.052421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded02b7-0121-45ed-badb-2681e96c3d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:57.053042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded02b7-0121-45ed-badb-2681e96c3d77 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.053328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded02b7-0121-45ed-badb-2681e96c3d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.053606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded02b7-0121-45ed-badb-2681e96c3d77 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.054560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded02b7-0121-45ed-badb-2681e96c3d77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:57.056034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded02b7-0121-45ed-badb-2681e96c3d77 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:57.068208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c5ed7-77f8-4e1d-ac62-151e6b6ebd20 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:57.107852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:57.114714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:57.115510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.115884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.116252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.117285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=5eb2a0bf9048456db54210694918b016) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:57.117706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:57.119300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:57.134015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 371/744] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:25:56 2022] GET /identity/v3/role_assignments?user.id=5eb2a0bf9048456db54210694918b016&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:57.134015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:57.152033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 374/745] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:25:56 2022] POST /identity/v3/services => generated 240 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:25:57.156916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958af81d-50e5-418a-9b80-0ea6d1929448 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.158062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958af81d-50e5-418a-9b80-0ea6d1929448 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.158561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958af81d-50e5-418a-9b80-0ea6d1929448 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.165090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 375/746] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:57.176342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb6b5-0fc6-4e41-b562-df9fce68f777 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.176812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb6b5-0fc6-4e41-b562-df9fce68f777 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.177333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb6b5-0fc6-4e41-b562-df9fce68f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.235353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d36bb6b5-0fc6-4e41-b562-df9fce68f777 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:57.237831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d36bb6b5-0fc6-4e41-b562-df9fce68f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:57.377785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:57.399016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51537526-a80d-414c-a5b2-b2eb4916aa0e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:57.399900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 376/747] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:25:57.434823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bb6b5-0fc6-4e41-b562-df9fce68f777 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:57.462224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:57.463723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.464250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.464916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.477365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:57.479324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:57.503776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:57.504827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:25:57.505862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:57.512010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 372/748] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:57.515779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:57.604771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:57.616874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bb6b5-0fc6-4e41-b562-df9fce68f777 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:57.660677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0bff-c102-400e-a904-11f48f9ad99b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:57.662159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:57.663335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.663896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.664421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.680291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:25:57.691678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:57.693484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:25:57.695193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:57.700349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 377/749] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:57.707038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:57.709734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:57.713015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.713943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.714724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.716719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:57.717600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:57.722831 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:57.787052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 373/750] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 08:25:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:57.793179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:57.870154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:57.930302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a0c82-c833-4517-9df3-fed137e893f3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:57.951223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:57.971526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:57.972461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:57.973024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:57.973606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:57.994817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694eda4-3484-432e-b2e3-1e44709e0aa2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:58.071858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:58.072561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:58.072847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:58.073122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:58.073926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:58.074244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:58.075686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:58.098464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 378/751] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:58.101365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:58.103819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:58.104524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:58.288113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cde1dc-564c-4eb8-a0aa-b33eebc17705 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:58.298554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:58.340151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:58.341536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:58.342089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:58.342587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:58.382824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:58.384349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:58.414048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 374/752] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:25:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:58.414898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:58.415993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:58.417224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:58.417224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:58.417224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:58.417224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:58.417224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 379/753] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:25:58.422780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:58.431976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:58.448890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:58.655935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17faa1-1e32-4ca3-95ea-77f8ac93d39e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:58.667804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e228650-290e-4a67-823e-c92dfb8d3ae0 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:58.700679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d98c00-512e-486e-ba17-8f7058a98a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:58.701891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d98c00-512e-486e-ba17-8f7058a98a27 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:58.702384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d98c00-512e-486e-ba17-8f7058a98a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:58.702885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d98c00-512e-486e-ba17-8f7058a98a27 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:58.704316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d98c00-512e-486e-ba17-8f7058a98a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:58.704876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d98c00-512e-486e-ba17-8f7058a98a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:58.708164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d98c00-512e-486e-ba17-8f7058a98a27 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:58.718941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7c01e-db97-4183-9940-2451b7e5940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:58.719751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c01e-db97-4183-9940-2451b7e5940f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:58.720038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c01e-db97-4183-9940-2451b7e5940f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:58.720316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7c01e-db97-4183-9940-2451b7e5940f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:58.733007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 380/754] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:58.734123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7c01e-db97-4183-9940-2451b7e5940f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:58.735501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806cb81-82b5-4a03-8a41-38cd67b50437 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:58.735833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7c01e-db97-4183-9940-2451b7e5940f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:58.736004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806cb81-82b5-4a03-8a41-38cd67b50437 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:58.736742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806cb81-82b5-4a03-8a41-38cd67b50437 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:58.739780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 381/755] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:58.741162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806cb81-82b5-4a03-8a41-38cd67b50437 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:58.774686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-bfc7c01e-db97-4183-9940-2451b7e5940f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:58.777344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:58.778503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:58.779607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:58.779607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:58.779607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:58.779607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:58.785852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 375/756] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:58.788366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f01c-ea04-4b75-8e1a-84aec27c5d23 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:58.788869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f01c-ea04-4b75-8e1a-84aec27c5d23 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:58.789362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f01c-ea04-4b75-8e1a-84aec27c5d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:58.814441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0470f01c-ea04-4b75-8e1a-84aec27c5d23 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:58.816057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0470f01c-ea04-4b75-8e1a-84aec27c5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:25:58.893599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:58.903416 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806cb81-82b5-4a03-8a41-38cd67b50437 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:58.913796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 376/757] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:25:58.913796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f01c-ea04-4b75-8e1a-84aec27c5d23 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:58.970009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:58.971160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:58.971659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:58.972168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:58.980876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:58.982703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:25:58.999499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:59.000604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:25:59.001549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:59.004946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 382/758] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:25:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:59.006099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.024204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f01c-ea04-4b75-8e1a-84aec27c5d23 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.066091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.066986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.067278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.067555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.068328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:59.068635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.070264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.084202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 377/759] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:59.085095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.104816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:59.127126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d873ec-27dc-4992-9259-e02fcd5b10cb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.162143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:59.176809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.177554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.178046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.178419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.179132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.180562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:59.199030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:59.201165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:25:59.203132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:59.205524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 383/760] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:59.206653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.276261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37502293-51ea-410f-a872-769ce7a56bd3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.314502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.315193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.315481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.315817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.317190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:59.317503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.319022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.343969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 378/761] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:59.344971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.404791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70b608-ba98-42a6-a253-822c2ae64c03 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.459830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306080d-c9ea-463a-9123-38ffd7b6bd0f None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.475796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:59.483049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.484787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.485553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.496424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.499927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.500781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.501178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.501562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.502528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:59.502889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.503290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.504634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.506604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.515580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 379/762] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:59.516436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:25:59.542928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:59.544722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:25:59.547050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:25:59.551132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 384/763] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:59.553054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.560532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:59.642045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b161d-0fa0-424d-a19a-3e2d133433d5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.685066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.685920 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.686208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.686489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.699197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.700723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:25:59.720755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:25:59.721729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:25:59.723249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:25:59.723249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:25:59.723249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:25:59.723249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:25:59.727341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 380/764] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:25:59.728240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.750188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807be8-26b9-4511-a369-53260c0caf84 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.762863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:59.796163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832533-1732-4be2-af4b-036c48196dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.796940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832533-1732-4be2-af4b-036c48196dbf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.797226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832533-1732-4be2-af4b-036c48196dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.797496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832533-1732-4be2-af4b-036c48196dbf None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.798262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832533-1732-4be2-af4b-036c48196dbf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:59.798566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832533-1732-4be2-af4b-036c48196dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.799940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832533-1732-4be2-af4b-036c48196dbf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.807354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 385/765] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:59.808790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153b6fb-a711-4f39-bd1c-501e0015b855 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.809074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153b6fb-a711-4f39-bd1c-501e0015b855 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.809341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153b6fb-a711-4f39-bd1c-501e0015b855 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.810919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 386/766] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:25:59.811445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153b6fb-a711-4f39-bd1c-501e0015b855 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:25:59.890472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89945c90-0c3d-4ba9-8d65-eb03bdd52eb6 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.908808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:25:59.937594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf297c-c64c-4c8d-8af2-ffa45f3edbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:25:59.938318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf297c-c64c-4c8d-8af2-ffa45f3edbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.938605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf297c-c64c-4c8d-8af2-ffa45f3edbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.938877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf297c-c64c-4c8d-8af2-ffa45f3edbb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.939834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf297c-c64c-4c8d-8af2-ffa45f3edbb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:25:59.940159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf297c-c64c-4c8d-8af2-ffa45f3edbb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:25:59.942843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf297c-c64c-4c8d-8af2-ffa45f3edbb8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:25:59.961239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 381/767] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:25:59.963774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb768f-cbce-4383-b6cb-b02328862e69 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:25:59.964362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb768f-cbce-4383-b6cb-b02328862e69 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:25:59.965122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb768f-cbce-4383-b6cb-b02328862e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:25:59.981104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153b6fb-a711-4f39-bd1c-501e0015b855 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:25:59.993410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-72eb768f-cbce-4383-b6cb-b02328862e69 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:25:59.995362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-72eb768f-cbce-4383-b6cb-b02328862e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:00.050969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:00.052441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.053147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.053896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.055489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:00.056544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:00.060802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:00.087468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 387/768] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:00.089725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:00.121729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 382/769] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:25:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:00.121729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb768f-cbce-4383-b6cb-b02328862e69 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:00.157924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:00.274945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efe6fd-1c27-49fb-8c4d-e2eaf4e65df7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:00.284299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb768f-cbce-4383-b6cb-b02328862e69 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:00.314424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:00.324344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:00.325230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.325663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.326085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.326998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] RBAC: Adding query filter params (interface=public, service_id=0dc0eeb10cda407bbdf515ddf75bb391, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:00.327401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:00.328873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:00.330886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:00.332383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.332732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.333080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.334051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=083f9aa9e5d84adbb8a82f1b0addd788) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:00.334415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:00.335946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:00.339909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 388/770] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:26:00 2022] GET /identity/v3/endpoints?service_id=0dc0eeb10cda407bbdf515ddf75bb391&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:00.340915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:00.344461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 383/771] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:00 2022] GET /identity/v3/role_assignments?user.id=083f9aa9e5d84adbb8a82f1b0addd788&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:00.346417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:00.487237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:00.521465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb5210-e29c-4080-aa3b-34dcd3951ddf None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:00.522284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6de64d-734f-4991-9942-e0641313d37f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:00.579443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf5d85-463a-4aff-ae4b-de28c4d5ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:00.579812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf5d85-463a-4aff-ae4b-de28c4d5ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.580583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf5d85-463a-4aff-ae4b-de28c4d5ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.580583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf5d85-463a-4aff-ae4b-de28c4d5ce22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.596623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:00.601342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.601600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf5d85-463a-4aff-ae4b-de28c4d5ce22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:00.601794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.602272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-d8bf5d85-463a-4aff-ae4b-de28c4d5ce22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:00.616262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:00.618140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:26:00.620737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:00.623171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:00.623425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 384/772] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:00.624124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:00.624450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8fc3d-8394-4315-813b-23faf9ccfe99 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.624450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8fc3d-8394-4315-813b-23faf9ccfe99 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.624450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8fc3d-8394-4315-813b-23faf9ccfe99 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.624450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 385/773] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:00.625326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8fc3d-8394-4315-813b-23faf9ccfe99 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:00.657058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:00.658227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:00.659109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:00.665985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 389/774] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:00.665985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:00.746270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:00.806247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8fc3d-8394-4315-813b-23faf9ccfe99 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:00.821051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c17ffe-96e5-4355-9c42-eddbf5450ec8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:00.865979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:00.867147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.867599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.868095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.869099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bace7-6af6-41e3-98b3-3f68540c11ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:00.869389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:00.869820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bace7-6af6-41e3-98b3-3f68540c11ee None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.870105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bace7-6af6-41e3-98b3-3f68540c11ee None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.870381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bace7-6af6-41e3-98b3-3f68540c11ee None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.871152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bace7-6af6-41e3-98b3-3f68540c11ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:00.871461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bace7-6af6-41e3-98b3-3f68540c11ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:00.871896 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:00.872937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bace7-6af6-41e3-98b3-3f68540c11ee None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:00.890112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 390/775] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:00.890112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2530f-7c4f-4327-9004-04a04d3f5f96 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:00.890483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 386/776] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:00 2022] GET /identity/v3/services => generated 772 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:00.890615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2530f-7c4f-4327-9004-04a04d3f5f96 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:00.890615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2530f-7c4f-4327-9004-04a04d3f5f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:00.890861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:00.908592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:00.920280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1bd2530f-7c4f-4327-9004-04a04d3f5f96 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:00.922464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1bd2530f-7c4f-4327-9004-04a04d3f5f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:01.062338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 391/777] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:01.063566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1632a-ca96-45b3-86ee-abb9b91687bd None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:01.063731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2530f-7c4f-4327-9004-04a04d3f5f96 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:01.121875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:01.122934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:01.123406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:01.123867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:01.125315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:01.126488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:01.128975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:01.154705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 387/778] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:01.155918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:01.180578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:01.249325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:01.289864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2530f-7c4f-4327-9004-04a04d3f5f96 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:01.297058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a325-c473-4035-a6c3-bcf3590e65aa None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:01.343690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:01.345101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:01.345557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:01.346003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:01.347380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:01.349638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:01.359510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:01.361074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:01.361987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:01.363181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:01.365635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:01.366786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:26:01.367611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:01.370629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 388/779] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:01 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:01.371688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:01.390253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:01.393746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:01.433541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:01.434523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:01.435403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:01.435403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:01.435403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:01.435403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:01.455426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 392/780] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:01.458040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:01.517908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b93031-15ec-49f5-85f7-f333ea1fd1ae None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:01.589063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:01.606519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:01.606519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:01.606519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:01.606519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/df173c85777f45dd8ed9fb11bad366b2/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:01.606937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=df173c85777f45dd8ed9fb11bad366b2, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:01.610860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:01.665322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:01.677057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128283-2f95-4d35-9b33-2d80dc102ac6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:01.710397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 389/781] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:26:01 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/df173c85777f45dd8ed9fb11bad366b2/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:26:01.711860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:01.771665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:01.772903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:01.773380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:01.773950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:01.775238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:01.775791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:01.786082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:01.797636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 393/782] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:01.807316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:01.855097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4b7f-6030-447f-9714-47e057447457 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:01.919881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:01.920962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:01.921440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:01.921949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:01.923310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:01.923809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:01.926830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:01.957734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 390/783] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:01.967368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:02.034998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7332cb6-b03a-4ab1-8c36-48996e2f06b3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:02.086008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:02.087073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:02.087590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:02.088070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:02.089132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] RBAC: Adding query filter params (type=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:02.089664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:02.091307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:02.098681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 394/784] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:02.104935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:02.131337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:02.142510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:02.288256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e49060-64c5-4002-bb17-0938032c67bd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:02.297629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73bf4-21f6-4fad-b497-702cd07ba66c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:02.365468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:02.366184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:02.366468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:02.366744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:02.367557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] RBAC: Adding query filter params (interface=public, service_id=8fdee50d1e6e4fba9dc6ec46645bc858, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:02.367872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:02.369281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:02.380811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 395/785] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:26:02 2022] GET /identity/v3/endpoints?service_id=8fdee50d1e6e4fba9dc6ec46645bc858&interface=public®ion_id=RegionOne => generated 194 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:02.387586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:02.402919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:02.403830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:02.404096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:02.404337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:02.419567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:02.421075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:02.448740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:02.450537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:02.452281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:02.463544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 391/786] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:26:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:02.470340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:02.589995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:02.616245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023626-8e0e-4be1-bc81-a3c440b5de60 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:02.663183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:02.667000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:02.667958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:02.667958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:02.668410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:02.669750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:02.680537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 396/787] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:02 2022] GET /identity/v3/services => generated 772 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:02.738724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133282-a2e4-4960-9528-4961b89516a4 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:02.774094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:02.849945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:02.851033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:02.851544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:02.852042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:02.853795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:02.854363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:02.857006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:02.908746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 392/788] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 08:26:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:02.914845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:03.135895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ca93-4c31-4d1c-a515-53b2e24fa7e6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:03.209882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:03.211283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:03.211795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:03.212301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:03.236001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:03.239603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:03.278756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:03.280608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:03.284089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:03.284089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:03.284089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:03.284089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:03.284089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 397/789] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:03.291774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:03.544180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c933-d3bc-4f62-8daa-f9dbeac2a346 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:03.631868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:03.632939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:03.633408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:03.633918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:03.635327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:03.635883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:03.638909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:03.661320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 393/790] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:03.676941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:03.687529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:03.881722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28732075-89ec-4718-b332-c91bf3844d82 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:03.931500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b6f7a-9784-40ac-8107-3389568db16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:03.932334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6f7a-9784-40ac-8107-3389568db16f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:03.932626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6f7a-9784-40ac-8107-3389568db16f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:03.932880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6f7a-9784-40ac-8107-3389568db16f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:03.944253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b6f7a-9784-40ac-8107-3389568db16f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:03.945739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b6f7a-9784-40ac-8107-3389568db16f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-922b6f7a-9784-40ac-8107-3389568db16f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:03.967666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:03.969458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:03.971608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 398/791] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:03.983699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:04.024199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f709d-cfeb-4ecf-9343-53fefbf4c78f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:04.024199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f709d-cfeb-4ecf-9343-53fefbf4c78f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:04.024199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f709d-cfeb-4ecf-9343-53fefbf4c78f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:04.025442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 399/792] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:04.032257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121564-2c63-4c21-9be9-999e788b0abe None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:04.032577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121564-2c63-4c21-9be9-999e788b0abe None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:04.032817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121564-2c63-4c21-9be9-999e788b0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:04.068035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:04.069699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-88121564-2c63-4c21-9be9-999e788b0abe None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:04.072133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-88121564-2c63-4c21-9be9-999e788b0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:04.210329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:04.224612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 400/793] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:04.228791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d18a5-88a8-4174-8618-06ab0f0b5767 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:04.264715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121564-2c63-4c21-9be9-999e788b0abe None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:04.287957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:04.288633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:04.288926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:04.289240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:04.290399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:04.290657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:04.292793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:04.308699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 394/794] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:04.314794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:04.451362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121564-2c63-4c21-9be9-999e788b0abe None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:04.480268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:04.494139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc771-20b2-4078-aa46-21a8077bceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:04.494967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc771-20b2-4078-aa46-21a8077bceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:04.495273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc771-20b2-4078-aa46-21a8077bceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:04.495557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc771-20b2-4078-aa46-21a8077bceb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:04.508756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2317d33-71f9-478b-961b-d0c08a960304 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:04.511528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fc771-20b2-4078-aa46-21a8077bceb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d92fc771-20b2-4078-aa46-21a8077bceb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:04.526598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:04.528652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 401/795] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:04.536515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4c2d-4e45-40cb-8a4d-f236b3e37c66 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:04.538393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4c2d-4e45-40cb-8a4d-f236b3e37c66 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:04.538393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4c2d-4e45-40cb-8a4d-f236b3e37c66 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:04.538393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 402/796] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:04.541092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868195-4c9b-40cf-bae1-76efa6d26101 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:04.541092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868195-4c9b-40cf-bae1-76efa6d26101 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:04.543615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868195-4c9b-40cf-bae1-76efa6d26101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:04.567959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5c868195-4c9b-40cf-bae1-76efa6d26101 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:04.569329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5c868195-4c9b-40cf-bae1-76efa6d26101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:04.587289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:04.590198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:04.591069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:04.591851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/5eb2a0bf9048456db54210694918b016/roles/7dd1048f7a5241ea811f20171d0b4bd4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:04.617903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=5eb2a0bf9048456db54210694918b016, role_id=7dd1048f7a5241ea811f20171d0b4bd4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:04.619830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:04.635210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:04.659795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 403/797] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:04.659795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868195-4c9b-40cf-bae1-76efa6d26101 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:04.704499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 395/798] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:26:04 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/5eb2a0bf9048456db54210694918b016/roles/7dd1048f7a5241ea811f20171d0b4bd4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:26:04.706628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:04.939769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868195-4c9b-40cf-bae1-76efa6d26101 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:05.011762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:05.013724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.014520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.015268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.016746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:05.017543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:05.020495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:05.030989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 404/799] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:26:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:05.038383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:05.104693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:05.162513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975e2ec-3f64-41c1-9cc9-42b82f588537 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:05.187684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4364d-4d5f-4bf7-ad61-73735c05f280 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:05.219395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95107450-d9c5-4fd2-95d2-d7ccf4342869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:05.220674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107450-d9c5-4fd2-95d2-d7ccf4342869 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.221204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107450-d9c5-4fd2-95d2-d7ccf4342869 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.222719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107450-d9c5-4fd2-95d2-d7ccf4342869 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.224526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95107450-d9c5-4fd2-95d2-d7ccf4342869 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:05.226291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95107450-d9c5-4fd2-95d2-d7ccf4342869 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-95107450-d9c5-4fd2-95d2-d7ccf4342869 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:05.244793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:05.245865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 08:26:05.246796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:05.254198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 396/800] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jul 18 08:26:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 545 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:05.256500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29724-78c1-45a7-9527-4617d503ff6f None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.265123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29724-78c1-45a7-9527-4617d503ff6f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.265123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29724-78c1-45a7-9527-4617d503ff6f None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.265123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 397/801] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:05.265123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29724-78c1-45a7-9527-4617d503ff6f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:05.265436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd1a5a-b63a-4f7a-b237-e7add077b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:05.265436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1a5a-b63a-4f7a-b237-e7add077b893 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.265436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1a5a-b63a-4f7a-b237-e7add077b893 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.265436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1a5a-b63a-4f7a-b237-e7add077b893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.266502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:05.291046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd1a5a-b63a-4f7a-b237-e7add077b893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:05.293123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd1a5a-b63a-4f7a-b237-e7add077b893 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ddcd1a5a-b63a-4f7a-b237-e7add077b893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:05.316717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:05.317721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:05.318630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:05.318630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:05.318630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:05.318630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:05.326035 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 405/802] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:05.331826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce47cf-069c-4fc2-89c4-c9e03293b9c3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.337922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce47cf-069c-4fc2-89c4-c9e03293b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.337922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce47cf-069c-4fc2-89c4-c9e03293b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.367015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-58ce47cf-069c-4fc2-89c4-c9e03293b9c3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:05.369139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-58ce47cf-069c-4fc2-89c4-c9e03293b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:05.431834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29724-78c1-45a7-9527-4617d503ff6f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:05.503729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:05.504508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 406/803] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:05.505778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.506510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce47cf-069c-4fc2-89c4-c9e03293b9c3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:05.506858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.507643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.509318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:05.510147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:05.513323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:05.523887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 398/804] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 08:26:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:05.534956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:05.582792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:05.671097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:05.724170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21307c2-9ba7-4dbc-ae7f-2e06f7bcfc94 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:05.745621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce47cf-069c-4fc2-89c4-c9e03293b9c3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:05.778376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:05.778974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.779259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.779534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.780367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:05.780876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:05.783196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:05.794686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 399/805] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 08:26:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:05.795463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:05.821977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990fff6-e2e6-47e5-bf05-08f772719b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:05.823149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990fff6-e2e6-47e5-bf05-08f772719b7f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.823652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990fff6-e2e6-47e5-bf05-08f772719b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.824154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990fff6-e2e6-47e5-bf05-08f772719b7f None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.825583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990fff6-e2e6-47e5-bf05-08f772719b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:05.826323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990fff6-e2e6-47e5-bf05-08f772719b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:05.828977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990fff6-e2e6-47e5-bf05-08f772719b7f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:05.853723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 407/806] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:05.853723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86afd-8195-41a6-a8fc-5b4004009229 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:05.853723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86afd-8195-41a6-a8fc-5b4004009229 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:05.853723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86afd-8195-41a6-a8fc-5b4004009229 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:05.853723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 408/807] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:05.854436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a86afd-8195-41a6-a8fc-5b4004009229 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:05.959468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041ad69-aa8e-4a6f-b73b-49c18e92823e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:05.994240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:06.011298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a86afd-8195-41a6-a8fc-5b4004009229 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:06.014572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:06.025256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a851-cf36-4ddd-a656-cc746122e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:06.026665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a851-cf36-4ddd-a656-cc746122e400 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:06.027151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a851-cf36-4ddd-a656-cc746122e400 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:06.027640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a851-cf36-4ddd-a656-cc746122e400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:06.048433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a851-cf36-4ddd-a656-cc746122e400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-ae05a851-cf36-4ddd-a656-cc746122e400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:06.064054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:06.065145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:06.067127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:06.073765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 400/808] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:06.073765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7769b6-a4d6-4f48-8d1f-6428b18604f1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:06.073765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7769b6-a4d6-4f48-8d1f-6428b18604f1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:06.073765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7769b6-a4d6-4f48-8d1f-6428b18604f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:06.084878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:06.085567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:06.085922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:06.086364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:06.088026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:06.090727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:06.101266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2a7769b6-a4d6-4f48-8d1f-6428b18604f1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:06.103458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2a7769b6-a4d6-4f48-8d1f-6428b18604f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:06.195045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 409/809] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:06.196343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:06.270288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 401/810] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:06.272612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7769b6-a4d6-4f48-8d1f-6428b18604f1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:06.414306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3c9ab-46fd-4257-aef1-6a5da5400089 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:06.494837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:06.496134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:06.496614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:06.497090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:06.513555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:06.516338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:06.529375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7769b6-a4d6-4f48-8d1f-6428b18604f1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:06.553717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:06.555654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:06.556897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 410/811] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:06.558176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:06.567338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:06.571487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:06.613144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:06.614361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:06.614849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:06.615334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:06.617862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:06.618747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:06.621989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:06.644531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 402/812] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:06.646112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:06.760748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc102cb-4221-4cee-b0be-bbdae780b150 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:06.823777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:06.825100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:06.825558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:06.826106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] PATH_INFO: `/v3/services/network` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:06.827525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:06.830007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:06.848160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067d810-9895-41c5-b20d-d5ec3e6c3ced None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:06.852264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:06.854196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:06.855869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 411/813] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:06 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:06.857417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:06.912141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:06.913356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:06.913978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:06.914447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:06.915963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:06.916476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:06.919175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:06.953779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 403/814] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 08:26:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:06.955223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:06.977910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:07.021420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:07.040583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc834e0f-2781-4ac5-a063-4b05e750f791 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:07.102191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:07.103536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:07.104065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:07.104539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:07.126589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:07.130330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:07.145287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6a39-ab18-4ea8-8ab6-7e9872eef8bd None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:07.167751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:07.169523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:07.171267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:07.171267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:07.171267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:07.171267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:07.173878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 412/815] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:07.176201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:07.214135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:07.215234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:07.215715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:07.216191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:07.217441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] RBAC: Adding query filter params (name=network) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:07.218153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:07.220923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:07.237089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 404/816] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:07.237089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:07.384140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e2f47-fe41-409c-85e6-1f8a9c7faa8d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:07.434161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:07.451766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:07.459934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68f232-b520-4036-9448-50334ee30b7b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:07.473184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:07.475078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:07.475204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:07.475952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:07.497762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:07.500914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:07.507578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:07.508549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:07.509017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:07.509520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:07.510491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:07.511215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:07.513051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:07.536236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 405/817] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:07.537479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:07.540111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:07.541027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:07.541946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:07.541946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:07.541946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:07.541946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:07.551120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 413/818] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:07.552509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:07.655525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b0097-5d3a-4229-afde-1907b76d1f46 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:07.698575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:07.699569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:07.700077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:07.700544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:07.701459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] RBAC: Adding query filter params (type=network) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:07.701977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:07.703597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:07.710862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 406/819] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:07.712134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:07.744837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:07.837518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37409e4-4597-4c0b-95da-95fadb45a306 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:07.881426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:07.882489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:07.882960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:07.883420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:07.884351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:07.884843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:07.886562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:07.901730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 407/820] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:07.902871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:07.945706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55c2ff-ba1d-4bcf-8d53-3a3719d69359 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:07.999670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:08.014991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:08.016532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.017137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.017726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.019924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27fb11-4c8e-40a9-9159-a0115a3d8177 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:08.035231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:08.038518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:08.060195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235390-74af-44a4-a947-8638e183929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:08.061178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235390-74af-44a4-a947-8638e183929b None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.061646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235390-74af-44a4-a947-8638e183929b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.062154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235390-74af-44a4-a947-8638e183929b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.063102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb235390-74af-44a4-a947-8638e183929b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:08.064663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb235390-74af-44a4-a947-8638e183929b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:08.070217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:08.071540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:08.072496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:08.077899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 414/821] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:26:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:08.079654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:08.119688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:08.174193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 408/822] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:08.177053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c8cf-77c7-4861-82e7-846ac8b91ba2 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.177617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c8cf-77c7-4861-82e7-846ac8b91ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.178171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c8cf-77c7-4861-82e7-846ac8b91ba2 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.180187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 409/823] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:08.181260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c8cf-77c7-4861-82e7-846ac8b91ba2 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:08.265460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1fab-dcbe-4bb4-bba9-6956c84bbaa5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:08.344590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f64242-29d7-46f0-8c64-98cf7ef09467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:08.346506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64242-29d7-46f0-8c64-98cf7ef09467 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.347833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64242-29d7-46f0-8c64-98cf7ef09467 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.348530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64242-29d7-46f0-8c64-98cf7ef09467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.362881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f64242-29d7-46f0-8c64-98cf7ef09467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:08.365808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f64242-29d7-46f0-8c64-98cf7ef09467 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-74f64242-29d7-46f0-8c64-98cf7ef09467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:08.401175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:08.402977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:08.404694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:08.409633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 415/824] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:08.412273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae18d2-d094-452d-9561-f63fd2801543 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.412600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae18d2-d094-452d-9561-f63fd2801543 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.412879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae18d2-d094-452d-9561-f63fd2801543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.437902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c8cf-77c7-4861-82e7-846ac8b91ba2 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:08.440417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-49ae18d2-d094-452d-9561-f63fd2801543 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:08.443014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-49ae18d2-d094-452d-9561-f63fd2801543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:08.510985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:08.512800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.513309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.513907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.515130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:08.515744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:08.517707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:08.537354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:08.555597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 410/825] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:26:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:08.556975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:08.605331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 416/826] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:08.606938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae18d2-d094-452d-9561-f63fd2801543 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:08.642156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:08.728757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a69fd-21c5-4231-b94a-f5cbd6a6ce5d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:08.778594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:08.779512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.779873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.780216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.781417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:08.781865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:08.783647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:08.785885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae18d2-d094-452d-9561-f63fd2801543 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:08.800678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 411/827] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:08.801851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:08.840975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac301ed-e8f5-4235-bb37-440aacffdac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:08.841991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac301ed-e8f5-4235-bb37-440aacffdac0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.842411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac301ed-e8f5-4235-bb37-440aacffdac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.843159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac301ed-e8f5-4235-bb37-440aacffdac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.879471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:08.928085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79101413-51e9-4a29-9fc6-9905707edfd1 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:08.930435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac301ed-e8f5-4235-bb37-440aacffdac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:08.931922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac301ed-e8f5-4235-bb37-440aacffdac0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:08.951272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:08.968604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:08.969921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:08.970386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:08.970825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:08.988485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:09.003080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:09.004237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:09.005337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 412/828] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:26:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:09.006075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.064209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 417/829] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:09.066184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d587249-5902-415c-a4d1-740b8a11d93b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.066469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d587249-5902-415c-a4d1-740b8a11d93b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.066744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d587249-5902-415c-a4d1-740b8a11d93b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.072468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 418/830] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:09.072468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d587249-5902-415c-a4d1-740b8a11d93b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.130265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d682f45-c694-4a2e-b166-6ba67555beef None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:09.148920 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:09.166727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:09.167629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.167920 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.168200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/083f9aa9e5d84adbb8a82f1b0addd788/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.170317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=083f9aa9e5d84adbb8a82f1b0addd788, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:09.171790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:09.200417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d587249-5902-415c-a4d1-740b8a11d93b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:09.220133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:09.240180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119d1c6-7d8c-4c60-a67e-3b5c31022ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:09.240863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119d1c6-7d8c-4c60-a67e-3b5c31022ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.241148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119d1c6-7d8c-4c60-a67e-3b5c31022ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.241426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119d1c6-7d8c-4c60-a67e-3b5c31022ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.242218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119d1c6-7d8c-4c60-a67e-3b5c31022ab8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:09.242528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119d1c6-7d8c-4c60-a67e-3b5c31022ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:09.243908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119d1c6-7d8c-4c60-a67e-3b5c31022ab8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:09.253380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 413/831] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:26:09 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/083f9aa9e5d84adbb8a82f1b0addd788/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:26:09.254885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.258417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 419/832] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:09.261283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340e980-a11d-4d41-8094-807d5dab39c1 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.261283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340e980-a11d-4d41-8094-807d5dab39c1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.261797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340e980-a11d-4d41-8094-807d5dab39c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.291209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f340e980-a11d-4d41-8094-807d5dab39c1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:09.293191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f340e980-a11d-4d41-8094-807d5dab39c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:09.386994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 420/833] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:09.388210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340e980-a11d-4d41-8094-807d5dab39c1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.450385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a5e4-32ac-4948-b9db-2e64e5a9f961 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:09.513495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:09.514880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.515301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.515712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.533165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:09.536385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:09.568422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:09.570566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:09.572329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:09.572329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:09.572329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:09.572329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:09.572329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 414/834] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:09.572884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340e980-a11d-4d41-8094-807d5dab39c1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:09.573020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.592080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:09.624159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:09.634333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:09.635636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.636089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.636541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.656038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:09.657735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:09.679590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:09.686828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:09.687931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:09.687931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:09.687931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:09.687931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:09.687931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 421/835] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:09.687931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.751102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb70d9-745f-48d6-a9b6-7164daa82b25 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:09.812015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:09.813700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.814181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.814676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.816526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:09.819425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:09.835761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda94c-a418-436e-bc96-7bc4416ed544 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:09.843304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:09.844368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:09.845209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:09.846559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 415/836] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:09.849757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.898788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:09.899833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:09.900297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:09.900755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:09.901939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:09.902456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:09.904586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:09.925046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 422/837] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:09.926067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:09.965976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:10.014055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:10.024648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c2c11-e0ac-4f05-a772-ff9772f7b01d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.087195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:10.088682 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:10.089193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:10.089761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:10.091099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:10.091657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:10.094295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:10.094821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049e5e-b9ac-4661-8d66-423b0cc79907 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.116788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 416/838] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:10.118368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:10.153341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:10.154553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:10.155040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:10.155523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:10.156877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:10.157363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:10.159882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:10.169773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 423/839] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:10.170601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:10.286957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4939-d8fe-4e2e-a4ce-3aa9365585b8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.311479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:10.332135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45cd5-e773-4a50-a3d3-e6f38f2668ad None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.351694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:10.352641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:10.353104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:10.353413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:10.365503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:10.367631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:10.395332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:10.395801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:10.397407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:10.407431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:10.409391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:10.409391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:10.409391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:10.410067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 417/840] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:10.410067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:10.421497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:10.424050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:10.435458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:10.451897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:10.453814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 424/841] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:10.457365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:10.576656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbd338-5e6d-4828-a3fc-3804c0089479 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.635374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:10.636442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:10.636866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:10.637328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:10.638496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:10.639024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:10.641394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:10.648630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a255ab-beb2-4f40-9601-1b73ffe57dbb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.657741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 418/842] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:10.657741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:10.730542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:10.731714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:10.733056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:10.733655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:10.735193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:10.735797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:10.739102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:10.761597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 425/843] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:10.769083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:10.787530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:10.835414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:10.885068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fe6e1-b720-426c-8852-9ac1d1910918 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.934237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:10.935104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:10.935553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:10.935943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:10.936895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:10.938783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:10.941209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:10.952794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789e1f7-7367-4566-9f14-25c8c2c86ca3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:10.970821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 419/844] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 08:26:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:10.980283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:11.001183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:11.003183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:11.004033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:11.004469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:11.005652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=df173c85777f45dd8ed9fb11bad366b2) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:11.006467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:11.008129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:11.017081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 426/845] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:10 2022] GET /identity/v3/role_assignments?user.id=df173c85777f45dd8ed9fb11bad366b2&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:11.110911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7abae9-86f0-4ebd-ad49-a1d9ecda3bc2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:11.155087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66e53d-c0a4-40eb-857d-91892b8724db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:11.155762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e53d-c0a4-40eb-857d-91892b8724db None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:11.156043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e53d-c0a4-40eb-857d-91892b8724db None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:11.156319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e53d-c0a4-40eb-857d-91892b8724db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:11.160743 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:11.247788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66e53d-c0a4-40eb-857d-91892b8724db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:11.250837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66e53d-c0a4-40eb-857d-91892b8724db None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:11.382470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 420/846] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 08:26:11.387801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:11.468352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:11.504153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7611d5-83ea-4be3-ac49-3852585fe82e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:11.552654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167725c8-916e-4071-b2b3-3e342b49e40a None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:11.553164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167725c8-916e-4071-b2b3-3e342b49e40a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:11.553721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167725c8-916e-4071-b2b3-3e342b49e40a None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:11.556511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 421/847] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:11.557579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:11.559007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:11.559504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:11.560002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:11.563339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab01c60-72c8-4207-a6d7-3b639010ff65 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:11.563903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab01c60-72c8-4207-a6d7-3b639010ff65 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:11.564386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab01c60-72c8-4207-a6d7-3b639010ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:11.577982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:11.579813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:11.600141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:11.601126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:11.602054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:11.602054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:11.602054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:11.602054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:11.602302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-dab01c60-72c8-4207-a6d7-3b639010ff65 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:11.603486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dab01c60-72c8-4207-a6d7-3b639010ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:11.605050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 427/848] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:11.617738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:11.660818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:11.730177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 422/849] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:11.754010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab01c60-72c8-4207-a6d7-3b639010ff65 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:11.838852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539d1c3-55c0-4dd4-bfb7-36412e5b4271 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:11.879367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab01c60-72c8-4207-a6d7-3b639010ff65 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:11.894634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:11.917292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:11.918442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:11.918934 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:11.919411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:11.920813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:11.921363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:11.925069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:11.926639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:11.927738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:11.928243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:11.928730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:11.948186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 428/850] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:11.951403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:11.966889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:11.991151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:11.992181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:11.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:11.997796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 423/851] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:12.003037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:12.038858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:12.131688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df050f3b-f4ed-46de-9ac0-feeb89318fc1 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:12.155961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee6c1e-d90f-45f9-9811-64bf4f5f2454 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:12.177072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:12.177661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.177978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.178251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.179541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:12.179541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:12.180761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:12.192086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 424/852] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:12.202697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:12.227774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:12.232656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.232656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.232656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.241866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:12.244140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:12.265801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:12.267780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:12.270258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:12.273973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 429/853] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:12.279818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:12.352871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:12.368670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8687b-ffa1-4140-95fe-ab5de0524e49 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:12.375595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:12.409462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:12.410721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.411062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.411400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.423469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:12.425851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:12.446438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:12.448391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:12.456922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:12.456922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:12.456922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:12.456922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:12.456922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 425/854] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:12.462431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:12.491573 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991165a-0d2a-459f-b6ba-3a3010cd9c19 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:12.539750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:12.540599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.541133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.541630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.542793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:12.543229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:12.545043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:12.568531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 430/855] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:12.570180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:12.643877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a6740-b0a2-44c5-93c1-0189e2bb7940 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:12.683961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:12.684793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.685179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.685556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.686444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:12.686850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:12.688355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:12.698580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:12.708377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 426/856] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:12.715011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:12.787421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ac93-2f5f-4f5a-bf89-87f3524e9423 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:12.791037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:12.827013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280eb36-96e5-4506-b904-2f4a5787c453 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:12.862076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8efbd9-48da-4872-bf45-e4979b0d5641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:12.863625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8efbd9-48da-4872-bf45-e4979b0d5641 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.864363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8efbd9-48da-4872-bf45-e4979b0d5641 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.865130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8efbd9-48da-4872-bf45-e4979b0d5641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.867109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8efbd9-48da-4872-bf45-e4979b0d5641 None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=5eb2a0bf9048456db54210694918b016) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:12.867587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:12.868318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8efbd9-48da-4872-bf45-e4979b0d5641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:12.868473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.868759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.868915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.872348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8efbd9-48da-4872-bf45-e4979b0d5641 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:12.878360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:12.880084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:12.886957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 431/857] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:12 2022] GET /identity/v3/role_assignments?user.id=5eb2a0bf9048456db54210694918b016&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:12.909880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ef4b-a996-414e-a0e9-6016c9425c7e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.910929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ef4b-a996-414e-a0e9-6016c9425c7e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:12.911703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:12.913458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 08:26:12.915456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:12.917422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ef4b-a996-414e-a0e9-6016c9425c7e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.918124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 427/858] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:12.919480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:12.921830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 432/859] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:12.929206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f02f-fef0-4d88-9e3d-7007af274771 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:12.930265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f02f-fef0-4d88-9e3d-7007af274771 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:12.931100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f02f-fef0-4d88-9e3d-7007af274771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:12.962860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5144f02f-fef0-4d88-9e3d-7007af274771 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:12.965663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5144f02f-fef0-4d88-9e3d-7007af274771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:13.007705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:13.070229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 433/860] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:13.085481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144f02f-fef0-4d88-9e3d-7007af274771 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:13.101866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2462d3-89c8-4410-9707-598c6176d51f None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:13.164391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:13.165118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:13.165409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:13.165712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:13.166587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:13.166898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:13.169267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:13.196574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 428/861] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 08:26:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:13.203077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:13.235359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:13.248539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144f02f-fef0-4d88-9e3d-7007af274771 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:13.307685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580d8cb-acba-46f2-9d86-e4ea01675817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:13.308615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d8cb-acba-46f2-9d86-e4ea01675817 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:13.309527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d8cb-acba-46f2-9d86-e4ea01675817 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:13.309982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d8cb-acba-46f2-9d86-e4ea01675817 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:13.311287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580d8cb-acba-46f2-9d86-e4ea01675817 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:13.313254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580d8cb-acba-46f2-9d86-e4ea01675817 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:13.336776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee437d-2c9c-4993-8d26-341f18d44a6e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:13.356958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:13.375320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:13.375972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:13.376255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:13.376530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:13.398431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 434/862] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:26:13 2022] POST /identity/v3/services => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:26:13.474984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:13.476557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:13.575258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbcc2-16bc-460d-bf86-a3e1c3e4151c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:13.575785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbcc2-16bc-460d-bf86-a3e1c3e4151c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:13.575785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbcc2-16bc-460d-bf86-a3e1c3e4151c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:13.577356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 435/863] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:13.583990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa36db-0001-4264-83b4-c717a2b2fa55 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:13.584651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa36db-0001-4264-83b4-c717a2b2fa55 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:13.585163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa36db-0001-4264-83b4-c717a2b2fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:13.606411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4aaa36db-0001-4264-83b4-c717a2b2fa55 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:13.607638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4aaa36db-0001-4264-83b4-c717a2b2fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:13.615584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 429/864] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:13.621936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:13.643815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:13.742691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 436/865] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:13.751064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761113-3465-4d7c-b91e-679b6840e4a2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:13.765631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa36db-0001-4264-83b4-c717a2b2fa55 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:13.792727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:13.793441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:13.793895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:13.794495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:13.807210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:13.808701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:13.829026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:13.830037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:13.831733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:13.831733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:13.831733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:13.831733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:13.831733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 430/866] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:13.837158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:13.879242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:13.907370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa36db-0001-4264-83b4-c717a2b2fa55 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:13.932726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:13.948650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:13.949585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:13.949999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:13.950279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:13.950947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:13.952465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:13.965364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:13.966420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:13.967262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:13.972164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 437/867] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jul 18 08:26:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:13.973077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657e593-db88-496e-bb5c-fa2065204403 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:13.973830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:14.013520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:14.014550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:14.015022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:14.015504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:14.016565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:14.017072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:14.018970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:14.032669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 431/868] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:14.042242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:14.129846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef30e51-5740-4ed4-bd8b-20650a5644ae None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:14.180861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:14.181928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:14.182459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:14.182946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:14.183979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:14.184479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:14.186086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:14.189237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ffedc-b71e-430a-8e50-0652961bd0a8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:14.192700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 438/869] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:14.204462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:14.220273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:14.256328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:14.266043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:14.267024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:14.267775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:14.267775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:14.284143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:14.286829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:14.317233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:14.318433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:14.319436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:14.325275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 432/870] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:14.326615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d128-ba2b-4b82-928f-af3d9c6cf1a8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:14.330370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:14.366517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:14.367466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:14.367909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:14.368341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:14.369239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:14.369735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:14.371298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:14.381943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 439/871] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:14.535304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b44748-c501-4fb8-b088-d55bda51ccaf None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:14.603747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52daed-6e98-4655-905b-549b1eecbe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:14.604790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52daed-6e98-4655-905b-549b1eecbe56 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:14.605234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52daed-6e98-4655-905b-549b1eecbe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:14.605669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52daed-6e98-4655-905b-549b1eecbe56 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:14.607122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52daed-6e98-4655-905b-549b1eecbe56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:14.607703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52daed-6e98-4655-905b-549b1eecbe56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:14.610239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52daed-6e98-4655-905b-549b1eecbe56 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:14.637933 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 433/872] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:14.642403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:14.739752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:14.765905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200b27d-000c-4fef-ae4d-1d4288fb3a3f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:14.808864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e336-ca52-45dd-a3b0-bad83b1f697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:14.809863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e336-ca52-45dd-a3b0-bad83b1f697a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:14.810303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e336-ca52-45dd-a3b0-bad83b1f697a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:14.810734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e336-ca52-45dd-a3b0-bad83b1f697a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:14.811850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e336-ca52-45dd-a3b0-bad83b1f697a None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=083f9aa9e5d84adbb8a82f1b0addd788) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:14.812323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e336-ca52-45dd-a3b0-bad83b1f697a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:14.813981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e336-ca52-45dd-a3b0-bad83b1f697a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:14.821814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 440/873] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:14 2022] GET /identity/v3/role_assignments?user.id=083f9aa9e5d84adbb8a82f1b0addd788&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:15.386117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa090226-fd56-4df1-a0ec-62fef0b7574f None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:15.386687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa090226-fd56-4df1-a0ec-62fef0b7574f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:15.386687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa090226-fd56-4df1-a0ec-62fef0b7574f None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:15.388382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 434/874] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:15.394443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb588-463a-436e-a06e-af71c83f7764 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:15.394731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb588-463a-436e-a06e-af71c83f7764 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:15.395007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb588-463a-436e-a06e-af71c83f7764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:15.413396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e08fb588-463a-436e-a06e-af71c83f7764 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:15.414948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e08fb588-463a-436e-a06e-af71c83f7764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:15.494030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 441/875] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:15.517341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa090226-fd56-4df1-a0ec-62fef0b7574f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:15.588406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:15.693332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa090226-fd56-4df1-a0ec-62fef0b7574f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:15.746899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:15.747935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:15.748314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:15.748798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:15.765623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:15.782404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:15.783511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:15.784938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:15.786155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 435/876] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 08:26:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:15.791298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fb588-463a-436e-a06e-af71c83f7764 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:15.864304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:15.905285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fb588-463a-436e-a06e-af71c83f7764 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:15.942786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:15.943938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:15.944461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:15.944954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:15.946003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:15.946533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:15.948184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:15.963534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 442/877] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 08:26:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:15.964454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:16.091005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8bce6-5d5b-4f35-8546-8834858f2929 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:16.106322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:16.134613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:16.135508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.135794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.136069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.149148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:16.150688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:16.171062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:16.172025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:16.172912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:16.172912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:16.172912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:16.172912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:16.172912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 436/878] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:16.179611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:16.294848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313360a-d64a-41af-8aa1-68d44ccebf6f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:16.327019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:16.333462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:16.334183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.334470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.334746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.335480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:16.335789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:16.337204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:16.351812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 443/879] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:16.357382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:16.495485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5282-8826-4e93-9d74-96586dbd6f1c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:16.538723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2580-ac0a-493c-9a93-515cc70c9955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:16.539546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2580-ac0a-493c-9a93-515cc70c9955 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.539895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2580-ac0a-493c-9a93-515cc70c9955 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.540187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2580-ac0a-493c-9a93-515cc70c9955 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.557715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d2580-ac0a-493c-9a93-515cc70c9955 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:16.557715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d2580-ac0a-493c-9a93-515cc70c9955 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-359d2580-ac0a-493c-9a93-515cc70c9955 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:16.581178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:16.583085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:16.584982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 437/880] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:26:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:16.597482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:16.791268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d6d0-f4be-4cd1-87d5-a5b1cfc58618 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:16.827430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f828-78ae-4236-8d6d-6cfb7cc90d8b None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.827674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f828-78ae-4236-8d6d-6cfb7cc90d8b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.828022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f828-78ae-4236-8d6d-6cfb7cc90d8b None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.829549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 438/881] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:16.836783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241e52-7d06-40e9-af89-f72a885d6c89 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.837180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241e52-7d06-40e9-af89-f72a885d6c89 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.837471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241e52-7d06-40e9-af89-f72a885d6c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.858252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1a241e52-7d06-40e9-af89-f72a885d6c89 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:16.859690 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f758e-6abe-4ef2-a268-c27879d43657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:16.860173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1a241e52-7d06-40e9-af89-f72a885d6c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:16.861623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f758e-6abe-4ef2-a268-c27879d43657 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.862325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f758e-6abe-4ef2-a268-c27879d43657 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.862846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f758e-6abe-4ef2-a268-c27879d43657 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.863916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f758e-6abe-4ef2-a268-c27879d43657 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:16.864442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f758e-6abe-4ef2-a268-c27879d43657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:16.866225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f758e-6abe-4ef2-a268-c27879d43657 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:16.886899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 444/882] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 08:26:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:16.888269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e1e3-0acd-4188-b353-e6cefe5f84c0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.888611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e1e3-0acd-4188-b353-e6cefe5f84c0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.888905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e1e3-0acd-4188-b353-e6cefe5f84c0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.890468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 445/883] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:16.894723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e1e3-0acd-4188-b353-e6cefe5f84c0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:16.898881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:16.952476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:16.966237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 439/884] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:16.972077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28922ba9-7ec1-446a-961c-d11f18cec593 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:16.972077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28922ba9-7ec1-446a-961c-d11f18cec593 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:16.972077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28922ba9-7ec1-446a-961c-d11f18cec593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:16.997043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-28922ba9-7ec1-446a-961c-d11f18cec593 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:16.998840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-28922ba9-7ec1-446a-961c-d11f18cec593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:17.041176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e1e3-0acd-4188-b353-e6cefe5f84c0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:17.093657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:17.094702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:17.095159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:17.095570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:17.125964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 440/885] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:17.128381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28922ba9-7ec1-446a-961c-d11f18cec593 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:17.234500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:17.238153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:17.282899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:17.319481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28922ba9-7ec1-446a-961c-d11f18cec593 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:17.326285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:17.380666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:17.382639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:17.383480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:17.384181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:17.385868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:17.388464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:17.411670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 446/886] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:16 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:17.412533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:17.416719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:17.417890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:17.418800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:17.419648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 441/887] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:17.420988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:17.570780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ec057-d13d-43bc-844a-75a1add66327 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:17.611262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:17.612682 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:17.612974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:17.613240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:17.614029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:17.615409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:17.620331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35ed6-3065-4b9e-a432-232048144772 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:17.657619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ee5c1-5d46-4fb8-8999-5eb2d1f69c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:17.658580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ee5c1-5d46-4fb8-8999-5eb2d1f69c11 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:17.658935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ee5c1-5d46-4fb8-8999-5eb2d1f69c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:17.659281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ee5c1-5d46-4fb8-8999-5eb2d1f69c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:17.669717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 447/888] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:26:17 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:17.675492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:17.682476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ee5c1-5d46-4fb8-8999-5eb2d1f69c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:17.684969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ee5c1-5d46-4fb8-8999-5eb2d1f69c11 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:17.693570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:17.702454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-503ee5c1-5d46-4fb8-8999-5eb2d1f69c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:17.714767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:17.716630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:17.719465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:17.719465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:17.719465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:17.719465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:17.721986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 442/889] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:17.723666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc960-c0cb-4773-af35-f0ea72685a4c None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:17.723979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc960-c0cb-4773-af35-f0ea72685a4c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:17.724308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc960-c0cb-4773-af35-f0ea72685a4c None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:17.726460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 443/890] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:17.726460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cc960-c0cb-4773-af35-f0ea72685a4c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:17.877765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043edc75-264a-4336-9766-7e45d71555d5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:17.922883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606c0d-7136-44ac-8f0f-53c6bf101aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:17.923603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606c0d-7136-44ac-8f0f-53c6bf101aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:17.924129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606c0d-7136-44ac-8f0f-53c6bf101aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:17.924644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606c0d-7136-44ac-8f0f-53c6bf101aa3 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:17.925294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606c0d-7136-44ac-8f0f-53c6bf101aa3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:17.925672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606c0d-7136-44ac-8f0f-53c6bf101aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:17.927240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606c0d-7136-44ac-8f0f-53c6bf101aa3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:17.932828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 448/891] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:17.939395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777b11-7465-4fc8-a5b4-ca4468251d23 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:17.939395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777b11-7465-4fc8-a5b4-ca4468251d23 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:17.939395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777b11-7465-4fc8-a5b4-ca4468251d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:17.940336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cc960-c0cb-4773-af35-f0ea72685a4c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:17.958359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-92777b11-7465-4fc8-a5b4-ca4468251d23 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:17.959581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-92777b11-7465-4fc8-a5b4-ca4468251d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:18.004785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.005448 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.005763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.006040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.006793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:18.007105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.008536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.023078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 444/892] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:18.030662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.051296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:18.060108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 449/893] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:18.073893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92777b11-7465-4fc8-a5b4-ca4468251d23 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.127198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:18.186283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37b7d-ba39-4971-97fc-a0d0935b94c6 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:18.255445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.256601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.257116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.257621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.258943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:18.259505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.262228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.263379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92777b11-7465-4fc8-a5b4-ca4468251d23 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:18.275952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 445/894] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:18.275952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.334949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.335762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.336045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.336514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.343942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.345663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:18.361229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:18.371406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 450/895] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:18.373226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.426864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cce208-ead0-4be8-9410-8eb45512b4ee None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:18.455905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:18.461020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:18.470356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.473476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.473476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.473476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.473476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.474799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:18.489756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:18.491417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:18.492458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 446/896] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:18.495816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.548709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e048ff-08bc-49ab-94ac-957860ee4ed6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:18.609016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.609739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.610013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.610294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.611487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] RBAC: Adding query filter params (interface=public, service_id=df20343a3d1a4f0eb60b252a1191b132, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:18.612367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.614033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.622438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 451/897] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/endpoints?service_id=df20343a3d1a4f0eb60b252a1191b132&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:18.629467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.636944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497e387-9618-4cf8-bf22-6f4b20959c4e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:18.703636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.705090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.705090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.705090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.706372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:18.706949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.708376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.728667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 447/898] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:18.728667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.786212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:18.795419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54df6-4a41-4a01-8d82-cf6554c11372 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:18.835695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:18.851495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b9d3-f4f6-4bf5-9be4-17c545c09e44 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:18.852321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.853464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.853895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.854273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.855138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:18.855484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.857348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.866775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 452/899] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:18.868855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:18.913964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:18.915051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:18.915503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:18.915946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:18.917043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:18.919703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:18.937722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 448/900] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/services => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:26:18.937722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:19.076401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bedc9-5f3c-4d00-995e-9cc3f6c1812a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:19.136272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68c20-d15f-4174-bf81-530943351783 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:19.154509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb47cc-572b-4fbc-a3e4-b807dd2fd173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:19.156003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb47cc-572b-4fbc-a3e4-b807dd2fd173 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:19.156154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:19.156239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb47cc-572b-4fbc-a3e4-b807dd2fd173 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:19.156479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb47cc-572b-4fbc-a3e4-b807dd2fd173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:19.158000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb47cc-572b-4fbc-a3e4-b807dd2fd173 None admin] RBAC: Adding query filter params (role.id=5e23b51b6b3048eeb871200df496698d, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=5eb2a0bf9048456db54210694918b016) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:19.158520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb47cc-572b-4fbc-a3e4-b807dd2fd173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:19.161368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb47cc-572b-4fbc-a3e4-b807dd2fd173 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:19.173448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 453/901] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/role_assignments?user.id=5eb2a0bf9048456db54210694918b016&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=5e23b51b6b3048eeb871200df496698d => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:19.202130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c9f9d-f6ad-4fd5-b4d8-a16729a341f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:19.202828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c9f9d-f6ad-4fd5-b4d8-a16729a341f0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:19.203288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c9f9d-f6ad-4fd5-b4d8-a16729a341f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:19.203551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c9f9d-f6ad-4fd5-b4d8-a16729a341f0 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:19.204333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c9f9d-f6ad-4fd5-b4d8-a16729a341f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:19.204640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c9f9d-f6ad-4fd5-b4d8-a16729a341f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:19.207276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c9f9d-f6ad-4fd5-b4d8-a16729a341f0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:19.219211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 449/902] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:19.919419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67431d-6484-40fe-bcc9-c6bbb1181523 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:19.919742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67431d-6484-40fe-bcc9-c6bbb1181523 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:19.920168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67431d-6484-40fe-bcc9-c6bbb1181523 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:19.921751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 454/903] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:19.929108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f2b8-eb31-47ca-894f-0650d999818d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:19.929892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f2b8-eb31-47ca-894f-0650d999818d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:19.930056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f2b8-eb31-47ca-894f-0650d999818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:19.949252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-5753f2b8-eb31-47ca-894f-0650d999818d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:19.950561 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5753f2b8-eb31-47ca-894f-0650d999818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:20.037716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 450/904] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:20.077807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67431d-6484-40fe-bcc9-c6bbb1181523 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:20.170183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:20.271772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67431d-6484-40fe-bcc9-c6bbb1181523 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:20.338897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:20.340343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:20.340873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:20.341363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:20.342773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:20.345386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:20.371205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:20.374639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:20.378327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 455/905] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jul 18 08:26:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:20.385724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753f2b8-eb31-47ca-894f-0650d999818d None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:20.530379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753f2b8-eb31-47ca-894f-0650d999818d None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:20.532963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:20.577274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:20.577982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:20.578266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:20.578540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:20.579264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:20.579571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:20.582137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:20.588135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 451/906] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:20.597937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:20.797411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95121f60-3f02-43c3-9ce7-3a27bad205e4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:20.835825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:20.859065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:20.860968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:20.860968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:20.862051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:20.863466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:20.864051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:20.866754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:20.876338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 456/907] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:20.887066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:21.074898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596d7c-40d3-4416-98c2-59aced3c0893 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:21.130145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb537-b024-45e1-8c0c-1717dc0e44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:21.130830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb537-b024-45e1-8c0c-1717dc0e44f1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:21.131119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb537-b024-45e1-8c0c-1717dc0e44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:21.131399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb537-b024-45e1-8c0c-1717dc0e44f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:21.132211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffb537-b024-45e1-8c0c-1717dc0e44f1 None admin] RBAC: Adding query filter params (interface=public, service_id=c5177a39caed470f8e8994691513fb59, region_id=RegionOne) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:21.132521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffb537-b024-45e1-8c0c-1717dc0e44f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:21.133950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffb537-b024-45e1-8c0c-1717dc0e44f1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:21.143212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 452/908] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:26:20 2022] GET /identity/v3/endpoints?service_id=c5177a39caed470f8e8994691513fb59&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:21.152657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:21.360997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade5be1-027d-421a-9be1-1b4876c6120f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:21.429239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb1227-f0ae-49e4-a29f-f756d69cc349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:21.430443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb1227-f0ae-49e4-a29f-f756d69cc349 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:21.430967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb1227-f0ae-49e4-a29f-f756d69cc349 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:21.431477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb1227-f0ae-49e4-a29f-f756d69cc349 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:21.432897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb1227-f0ae-49e4-a29f-f756d69cc349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:21.435584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb1227-f0ae-49e4-a29f-f756d69cc349 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:21.449106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 457/909] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:21 2022] GET /identity/v3/services => generated 1268 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:26:21.612764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1e79-1203-46e0-bd82-f2e070760fa0 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:21.612764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1e79-1203-46e0-bd82-f2e070760fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:21.612764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d1e79-1203-46e0-bd82-f2e070760fa0 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:21.612764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 453/910] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:21.620553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425cc9-f5d0-467c-9faa-db0897d53d36 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:21.621033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425cc9-f5d0-467c-9faa-db0897d53d36 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:21.621505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425cc9-f5d0-467c-9faa-db0897d53d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:21.633592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a933b-227a-4dc9-9b12-bee944eb083e None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:21.633971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a933b-227a-4dc9-9b12-bee944eb083e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:21.634182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a933b-227a-4dc9-9b12-bee944eb083e None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:21.635847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 454/911] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:21.641355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea973d-fd13-4bef-8b85-47fdc504613d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:21.641711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea973d-fd13-4bef-8b85-47fdc504613d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:21.641956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea973d-fd13-4bef-8b85-47fdc504613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:21.653013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7e425cc9-f5d0-467c-9faa-db0897d53d36 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:21.655131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7e425cc9-f5d0-467c-9faa-db0897d53d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:21.662759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-cbea973d-fd13-4bef-8b85-47fdc504613d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:21.664005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cbea973d-fd13-4bef-8b85-47fdc504613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:21.701897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:21.730758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:21.749922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 455/912] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:21.770010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea973d-fd13-4bef-8b85-47fdc504613d None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:21.795585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 458/913] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:21.817471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425cc9-f5d0-467c-9faa-db0897d53d36 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:21.966582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea973d-fd13-4bef-8b85-47fdc504613d None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.008956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425cc9-f5d0-467c-9faa-db0897d53d36 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.039222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752558b-2f88-488d-a8fe-0425586bd18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:22.040654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752558b-2f88-488d-a8fe-0425586bd18f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.041167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752558b-2f88-488d-a8fe-0425586bd18f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.041670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752558b-2f88-488d-a8fe-0425586bd18f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.067435 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752558b-2f88-488d-a8fe-0425586bd18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:22.085764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f3618-dd2c-4a98-bead-d9bcf37dc7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:22.087137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3618-dd2c-4a98-bead-d9bcf37dc7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.087616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3618-dd2c-4a98-bead-d9bcf37dc7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.088101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3618-dd2c-4a98-bead-d9bcf37dc7f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-6752558b-2f88-488d-a8fe-0425586bd18f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:22.088261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:22.090680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:22.092772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:22.094337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f3618-dd2c-4a98-bead-d9bcf37dc7f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:22.094493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 456/914] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 08:26:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:22.094493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91137-2ebc-417d-ac86-006eebc410cc None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.094493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91137-2ebc-417d-ac86-006eebc410cc None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.094893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91137-2ebc-417d-ac86-006eebc410cc None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.102657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f3618-dd2c-4a98-bead-d9bcf37dc7f8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:22.102969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 457/915] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:22.102969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91137-2ebc-417d-ac86-006eebc410cc None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e02f3618-dd2c-4a98-bead-d9bcf37dc7f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:22.115212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:22.117330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 08:26:22.120649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:22.124272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 459/916] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:22.124272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692a6b-e26a-4a46-b636-a3d171c0bfc6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.124272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692a6b-e26a-4a46-b636-a3d171c0bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.124272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692a6b-e26a-4a46-b636-a3d171c0bfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.142869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-57692a6b-e26a-4a46-b636-a3d171c0bfc6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:22.144014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-57692a6b-e26a-4a46-b636-a3d171c0bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:22.151458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:22.181383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:22.231849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 460/917] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:22.239318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57692a6b-e26a-4a46-b636-a3d171c0bfc6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:22.320866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91137-2ebc-417d-ac86-006eebc410cc None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.382966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57692a6b-e26a-4a46-b636-a3d171c0bfc6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.400863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:22.401847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.402015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.402192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.402935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:22.403242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:22.404655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:22.421569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 458/918] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 08:26:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:22.421569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:22.440341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:22.441353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.441353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.441886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.442682 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:22.443094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:22.444514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:22.450899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 461/919] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:22.451598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:22.492179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:22.569517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:22.592654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbce40-db30-4f60-9530-03645eb124ff None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.634222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34ed02-1ae4-419e-a611-7d21fac74c1b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.655945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:22.657176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.657648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.658893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.660336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:22.662492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:22.686871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:22.687674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.687946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.688220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.699877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:22.701340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:22.721875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:22.723839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:22.726348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:22.726348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:22.726348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:22.726348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:22.726348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 462/920] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:22.726348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:22.735675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 459/921] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:26:22 2022] POST /identity/v3/services => generated 241 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:22.739417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:22.886146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:22.902958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad5d0-060a-4736-aaf2-277f87b040d4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.969041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:22.969929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:22.970225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:22.971028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:22.971888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:22.972209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:22.973757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:22.980776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 463/922] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 08:26:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:22.985118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655526-7b13-4986-a14c-b5a82ca74d29 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:22.988240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:23.046440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:23.048273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:23.049436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:23.049937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:23.050895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:23.051410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:23.053624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:23.070806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 460/923] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:23.079074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:23.093034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:23.160285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeceb88-7ae2-4e76-9ab0-ad96ece0493e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:23.200824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:23.201515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:23.201827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:23.202200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:23.202964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:23.204421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:23.244971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15deda-1851-440a-9b4c-9feba1162b74 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:23.295727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:23.311677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:23.313096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:23.313607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:23.314194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:23.328753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:23.331795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:23.355824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 464/924] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:23.364251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:23.365292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:23.366296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:23.370118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 461/925] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:26:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:23.373488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:23.556110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4b7d-64be-4f70-b8ff-fba57bcbfbae None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:23.600009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:23.600877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:23.601173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:23.601450 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:23.602365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:23.602746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:23.604233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:23.629219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 465/926] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 08:26:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:23.635468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:23.761728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:23.837137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bad9c-8221-43fa-bf1b-002969e9ccdd None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:23.884671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23662f-5dc3-4acb-9432-0d364ba9bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:23.885481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23662f-5dc3-4acb-9432-0d364ba9bdcd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:23.885811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23662f-5dc3-4acb-9432-0d364ba9bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:23.886141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23662f-5dc3-4acb-9432-0d364ba9bdcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:23.898880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23662f-5dc3-4acb-9432-0d364ba9bdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:23.900434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23662f-5dc3-4acb-9432-0d364ba9bdcd None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-8d23662f-5dc3-4acb-9432-0d364ba9bdcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:23.920044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:23.921009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:23.922408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:23.922408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:23.922408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:23.922408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:23.922408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 462/927] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:23.927464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:23.985586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:24.028211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096482e-f6ae-401e-bd5c-48f6321fa062 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.028539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096482e-f6ae-401e-bd5c-48f6321fa062 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.028775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096482e-f6ae-401e-bd5c-48f6321fa062 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.030405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 463/928] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:24.037178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6e682-5815-43cc-8d89-a5d1fcc88790 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.037850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6e682-5815-43cc-8d89-a5d1fcc88790 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.038341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6e682-5815-43cc-8d89-a5d1fcc88790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.050001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17651fc-dd74-428a-8072-665d03d684c3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:24.057576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6af6e682-5815-43cc-8d89-a5d1fcc88790 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:24.059229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6af6e682-5815-43cc-8d89-a5d1fcc88790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:24.100330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:24.101660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.102429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.103134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.104280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:24.105131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:24.107817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:24.133718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 466/929] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:24.138765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:24.153500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 464/930] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:24.183353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6e682-5815-43cc-8d89-a5d1fcc88790 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:24.262261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:24.322339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c50901-869c-4bb4-9f04-362fcf3273d5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:24.333563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6e682-5815-43cc-8d89-a5d1fcc88790 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:24.353026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:24.381134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:24.382105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.382463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.382812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.383712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:24.385915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:24.395835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:24.397521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.398334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.399088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:24.400837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:24.402895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:24.404653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 465/931] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jul 18 08:26:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:24.417852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:24.419448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:24.422434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:24.452577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:24.454385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:24.457295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:24.466163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 467/932] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:24.472345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:24.542852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb5e60-a405-4742-9e9f-f443e16fc286 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:24.562300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:24.589931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:24.591062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.591473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.591855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.592688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:24.593104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:24.594886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:24.605810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 466/933] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:24.611629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:24.667552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5b03-20b1-4115-8c8e-c3c53222f2ce None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:24.734950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:24.737292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.737907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.738485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.739994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:24.740673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:24.743414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:24.770244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadc66-38ac-455c-9398-cd85280840e7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:24.770453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 468/934] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:24.777503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:24.825288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:24.826365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:24.826907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:24.827783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:24.828736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:24.829962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:24.832100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:24.845073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 467/935] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:24.845899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:24.846847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:24.906085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:24.981791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250467a5-36fd-4882-9951-7550e6a53bf8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:24.987650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c723e3-c831-4180-a604-35f2ec3e84fd None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:25.038320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c426c-391c-4c81-bb58-60f94d90bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:25.039708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c426c-391c-4c81-bb58-60f94d90bc1b None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:25.040658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c426c-391c-4c81-bb58-60f94d90bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:25.041147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c426c-391c-4c81-bb58-60f94d90bc1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:25.042477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c426c-391c-4c81-bb58-60f94d90bc1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:25.044393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c426c-391c-4c81-bb58-60f94d90bc1b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:25.052916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82da3d5-dc64-44c1-b256-3d56726001b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:25.054518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82da3d5-dc64-44c1-b256-3d56726001b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:25.055018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82da3d5-dc64-44c1-b256-3d56726001b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:25.055858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82da3d5-dc64-44c1-b256-3d56726001b8 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/5eb2a0bf9048456db54210694918b016/roles/5e23b51b6b3048eeb871200df496698d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:25.059421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82da3d5-dc64-44c1-b256-3d56726001b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=5eb2a0bf9048456db54210694918b016, role_id=5e23b51b6b3048eeb871200df496698d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:25.062208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82da3d5-dc64-44c1-b256-3d56726001b8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:25.128754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 468/936] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:26:25.163308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 469/937] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:26:24 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/5eb2a0bf9048456db54210694918b016/roles/5e23b51b6b3048eeb871200df496698d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:26:25.732305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a8a0-c47e-4507-8428-640716c69f88 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:25.732819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a8a0-c47e-4507-8428-640716c69f88 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:25.732929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a8a0-c47e-4507-8428-640716c69f88 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:25.734596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 469/938] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:25.741312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a37c5-b9b0-4a1e-ad94-57cab5a802a5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:25.741312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a37c5-b9b0-4a1e-ad94-57cab5a802a5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:25.741312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a37c5-b9b0-4a1e-ad94-57cab5a802a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:25.759585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ca7a37c5-b9b0-4a1e-ad94-57cab5a802a5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:25.761057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ca7a37c5-b9b0-4a1e-ad94-57cab5a802a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:25.846399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 470/939] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:25.866044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a8a0-c47e-4507-8428-640716c69f88 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:25.927584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f3d8-4b7e-4e1e-beed-daa3bbd513b3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:25.927822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f3d8-4b7e-4e1e-beed-daa3bbd513b3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:25.928154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f3d8-4b7e-4e1e-beed-daa3bbd513b3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:25.929597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 471/940] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:25.940490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce08a43-c36d-4818-959e-e6de0bc22d32 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:25.941579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce08a43-c36d-4818-959e-e6de0bc22d32 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:25.942360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce08a43-c36d-4818-959e-e6de0bc22d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:25.972443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1ce08a43-c36d-4818-959e-e6de0bc22d32 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:25.975204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1ce08a43-c36d-4818-959e-e6de0bc22d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:25.976095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:25.984333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a8a0-c47e-4507-8428-640716c69f88 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:26.006088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:26.027391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:26.028362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:26.028808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:26.029154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:26.030092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:26.031597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:26.034031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING keystone.server.flask.common [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 08:26:26.081993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.sql.core [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 08:26:26.081993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 08:26:26.081993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [parameters: {'id': '35f01a0ec7cb46b3af4fdba11d83dadc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 08:26:26.081993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80328) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 35f01a0ec7cb46b3af4fdba11d83dadc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 35f01a0ec7cb46b3af4fdba11d83dadc. Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application conn.query(q) Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 08:26:26.090185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result.read() Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 08:26:26.091893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application next(self.gen) Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application yield resource Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application next(self.gen) Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise self.value Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application session.commit() Jul 18 08:26:26.094072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.session.flush() Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application compat.raise_( Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 08:26:26.097288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 08:26:26.099477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application conn.query(q) Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result.read() Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 08:26:26.101320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [parameters: {'id': '35f01a0ec7cb46b3af4fdba11d83dadc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:26.108495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:26.112965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 35f01a0ec7cb46b3af4fdba11d83dadc. Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 470/941] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Jul 18 08:26:25 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:26.119381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:26.126419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 472/942] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:26.151893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce08a43-c36d-4818-959e-e6de0bc22d32 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:26.254625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7784-3f6f-4a22-8482-96a03519254d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:26.296927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:26.297892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:26.298277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:26.300513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:26.308994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:26.310987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:26.328755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:26.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:26.332915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:26.333947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 471/943] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:26.342502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:26.358936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:26.366697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce08a43-c36d-4818-959e-e6de0bc22d32 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:26.445767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:26.445767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:26.445767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:26.445767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:26.446343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:26.447579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:26.471529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:26.472807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:26.473804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:26.479554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 473/944] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:26.481766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:26.501027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:26.503518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d43f1-91b7-4cfe-a35d-185168e75809 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:26.550825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:26.551900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:26.552392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:26.552857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:26.554002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:26.554793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:26.556478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:26.581924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 472/945] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:26.613815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588faac9-cf10-4f9d-a361-fcc8a21b10ef None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:26.655586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:26.656277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:26.656564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:26.656846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:26.657582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:26.658024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:26.659886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:26.666126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 474/946] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:26.672113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:26.796729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:26.845526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5c9dd-2a96-4463-947a-2577f11951a8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:26.894350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:26.894961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:26.895248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:26.895576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:26.896394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:26.896897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:26.898437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:26.907651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 473/947] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:26.918185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:27.042654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:27.067897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326559-9dd0-4e4e-b3d0-3bbfc66a0d67 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:27.106685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276c5b1-4499-418c-8b69-0e6bafe9e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:27.107364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c5b1-4499-418c-8b69-0e6bafe9e31b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.107648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c5b1-4499-418c-8b69-0e6bafe9e31b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.107919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c5b1-4499-418c-8b69-0e6bafe9e31b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.108720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276c5b1-4499-418c-8b69-0e6bafe9e31b None admin] RBAC: Adding query filter params (interface=public, service_id=0912226d006a4eca8e29d5c32a337c83, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:27.109028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276c5b1-4499-418c-8b69-0e6bafe9e31b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:27.110689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276c5b1-4499-418c-8b69-0e6bafe9e31b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:27.117404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 475/948] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:26:26 2022] GET /identity/v3/endpoints?service_id=0912226d006a4eca8e29d5c32a337c83&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:27.123045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:27.242208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de055-7f76-4600-b7de-7d0d32ec70e9 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:27.282258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c57711-5589-4eee-b2f9-89165732d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:27.283611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57711-5589-4eee-b2f9-89165732d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.284129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57711-5589-4eee-b2f9-89165732d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.284578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57711-5589-4eee-b2f9-89165732d1f0 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.285293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c57711-5589-4eee-b2f9-89165732d1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:27.286732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c57711-5589-4eee-b2f9-89165732d1f0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:27.288007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:27.295294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 474/949] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:27 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:26:27.498698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2d077-84b0-4568-aa4d-5d785cf82bdb None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.498934 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2d077-84b0-4568-aa4d-5d785cf82bdb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.499319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2d077-84b0-4568-aa4d-5d785cf82bdb None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.500969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 476/950] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:27.509778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5f49-c935-40aa-bdac-d631eefe3530 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.510654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5f49-c935-40aa-bdac-d631eefe3530 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.511407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5f49-c935-40aa-bdac-d631eefe3530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.540360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-dffe5f49-c935-40aa-bdac-d631eefe3530 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:27.545216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dffe5f49-c935-40aa-bdac-d631eefe3530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:27.559863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de68d01-56a6-4af3-9f41-7890d2580b2b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.560211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de68d01-56a6-4af3-9f41-7890d2580b2b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.560423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de68d01-56a6-4af3-9f41-7890d2580b2b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.562156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 477/951] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:27.568061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99b8e8-bbe6-47fb-8646-6e53f00ffd47 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.568429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99b8e8-bbe6-47fb-8646-6e53f00ffd47 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.568667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99b8e8-bbe6-47fb-8646-6e53f00ffd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.586926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0c99b8e8-bbe6-47fb-8646-6e53f00ffd47 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:27.588218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0c99b8e8-bbe6-47fb-8646-6e53f00ffd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:27.637371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 475/952] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:27.671746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 478/953] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:27.679510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5f49-c935-40aa-bdac-d631eefe3530 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:27.695177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99b8e8-bbe6-47fb-8646-6e53f00ffd47 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:27.778166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:27.802977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5f49-c935-40aa-bdac-d631eefe3530 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:27.818652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99b8e8-bbe6-47fb-8646-6e53f00ffd47 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:27.837457 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:27.848187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:27.849023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.851843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.851843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.863680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:27.865564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:27.866647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:27.867096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:27.867542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:27.868385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:27.870245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:27.874001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:27.875239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:27.876171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 476/954] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 08:26:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:27.884720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:27.887358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:27.888546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:27.889412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:27.891322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 479/955] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:27.898786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:28.010706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1643d-94a3-4ceb-a168-beb9dbaba204 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:28.013900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9e259-95f8-45a2-b190-85761957de9a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:28.049819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:28.050697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:28.050987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:28.051262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:28.052120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:28.052426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:28.052864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:28.053792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:28.053900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:28.054410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:28.054889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:28.055808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:28.056323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:28.057981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:28.059477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:28.065765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 477/957] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 08:26:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:28.069137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 480/957] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:28.070923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:28.071997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:28.142909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:28.187942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86491041-098d-4d79-ab30-13db836aa1dd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:28.190099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b7a37-b1c3-496e-843e-62cd0d230abb None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:28.226235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:28.227052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:28.227344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:28.227610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:28.228518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:28.228891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:28.230651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:28.231596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:28.235361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:28.235361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:28.235361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:28.242164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 481/958] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:28.248483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:28.250457 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:28.271424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:28.272404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:28.273317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:28.273317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:28.273317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:28.273317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:28.275882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 478/959] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:28.282015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:28.357130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:28.408520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ba27-e2c8-4753-9876-1ae02ba97b5c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:28.447914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:28.448591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:28.448880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:28.449159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:28.449917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:28.450227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:28.451607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:28.465258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 482/960] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:28.471650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:28.586684 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec24d-597b-4540-b2f1-93ff578fb37e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:28.588389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:28.630545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:28.631741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:28.632234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:28.632723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:28.641085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:28.643536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:28.660940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:28.662043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 08:26:28.663003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:28.670237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 479/961] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:26:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:28.672676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:28.786047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1176e-813a-4176-874a-2754a2d77c93 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:28.814642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:28.827322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:28.828012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:28.830280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:28.830280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:28.830280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:28.830717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:28.831998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:28.852530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 483/962] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 08:26:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:28.858215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:28.967047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f280d-9819-4b85-a3d9-34bface505a2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:29.006798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:29.007851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.008353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.008878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.046098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:29.089369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:29.091248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:29.201600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 480/963] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:29.207817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:29.326292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a9042-7654-45fb-8f12-5174d48d06d4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:29.363196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:29.364003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.364286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.364560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.375586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:29.377672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:29.409318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:29.410604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:29.412296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:29.412296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:29.412296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:29.412296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:29.412296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 484/964] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:29.419557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:29.495403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:29.539506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6521f6-6aef-45ca-842f-e3040fe536f2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:29.579826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31ffc-303d-408e-ab6f-34285d9db1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:29.580389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31ffc-303d-408e-ab6f-34285d9db1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.580677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31ffc-303d-408e-ab6f-34285d9db1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.580956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31ffc-303d-408e-ab6f-34285d9db1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.581734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d31ffc-303d-408e-ab6f-34285d9db1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:29.582050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d31ffc-303d-408e-ab6f-34285d9db1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:29.583453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d31ffc-303d-408e-ab6f-34285d9db1b8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:29.602010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 481/965] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:29.603668 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:29.639070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:29.714781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf62a-a021-4b5c-88e4-3bf589fb01d1 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.716165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf62a-a021-4b5c-88e4-3bf589fb01d1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.716659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf62a-a021-4b5c-88e4-3bf589fb01d1 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.719450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 482/966] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:29.721972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50465b-9375-4883-be2f-1bce189a6a3f None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.722496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50465b-9375-4883-be2f-1bce189a6a3f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.722892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50465b-9375-4883-be2f-1bce189a6a3f None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.725736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 483/967] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:29.731457 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf366-2849-4822-86b7-6fa51a635b20 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.731873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf366-2849-4822-86b7-6fa51a635b20 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.732215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf366-2849-4822-86b7-6fa51a635b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.749446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49391766-2f64-4bde-8449-b4642a684f3a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:29.751124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4a7cf366-2849-4822-86b7-6fa51a635b20 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:29.752596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4a7cf366-2849-4822-86b7-6fa51a635b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:29.793273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04be87d-5500-4e26-b201-e7aa09ae1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:29.794179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04be87d-5500-4e26-b201-e7aa09ae1c41 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.794422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04be87d-5500-4e26-b201-e7aa09ae1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.794422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04be87d-5500-4e26-b201-e7aa09ae1c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.806295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04be87d-5500-4e26-b201-e7aa09ae1c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:29.807778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04be87d-5500-4e26-b201-e7aa09ae1c41 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f04be87d-5500-4e26-b201-e7aa09ae1c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:29.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:29.825409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 485/968] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211224-67f9-4267-abd5-751d8d0bf9dc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:29.827302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211224-67f9-4267-abd5-751d8d0bf9dc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:29.829102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211224-67f9-4267-abd5-751d8d0bf9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:29.845879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c6211224-67f9-4267-abd5-751d8d0bf9dc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:29.846951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c6211224-67f9-4267-abd5-751d8d0bf9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:29.857284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 484/969] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:29.858189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf366-2849-4822-86b7-6fa51a635b20 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:29.922194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:29.938017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 486/970] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:29.938017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6211224-67f9-4267-abd5-751d8d0bf9dc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:29.973756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:29.982463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf366-2849-4822-86b7-6fa51a635b20 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.039141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.040307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.040814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.041273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.042797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:30.043360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.046213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.060886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6211224-67f9-4267-abd5-751d8d0bf9dc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.070462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 485/971] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:30.070462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:30.109091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.110625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.111470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.111919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.112663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.114129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:30.127747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:30.129164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:30.130255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 487/972] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:30.131301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:30.235401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:30.239434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b566-011f-430d-90d9-7c5d80608ae7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.255548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:30.257897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214853b-17e8-428d-a171-0fdcde4fbedd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.279848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.280619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.280907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.281179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.281944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.283532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.297008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.297724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.298005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.298803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.299669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] RBAC: Adding query filter params (role.id=5e23b51b6b3048eeb871200df496698d, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=5eb2a0bf9048456db54210694918b016) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:30.299984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.301495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.314491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 488/973] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:30 2022] GET /identity/v3/role_assignments?user.id=5eb2a0bf9048456db54210694918b016&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=5e23b51b6b3048eeb871200df496698d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:30.314491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:30.339401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.sql.core [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 08:26:30.339401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 08:26:30.339401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [parameters: {'user_id': 'c823f0ff59704edba024a6a1188a9dda', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 08:26:30.339401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80328) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application conn.query(q) Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result.read() Jul 18 08:26:30.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 08:26:30.352147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application next(self.gen) Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application yield resource Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application next(self.gen) Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise self.value Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application session.commit() Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 08:26:30.353114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.session.flush() Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application compat.raise_( Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 08:26:30.354637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 08:26:30.357216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application conn.query(q) Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application result.read() Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 08:26:30.359517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c823f0ff59704edba024a6a1188a9dda', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:30.363678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 08:26:30.366939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 08:26:30.370853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 08:26:30.370853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 08:26:30.370853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 08:26:30.370853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 08:26:30.370853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 08:26:30.370853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:30.370853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 486/974] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 08:26:30 2022] POST /identity/v3/users => generated 160 bytes in 288 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:30.372229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:30.456649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf18fda-d82a-4ec1-b95e-541b478f630a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.497511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.498238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.498523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.498798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.499518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:30.499826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.502516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1924c0-a3bc-46e0-ba81-e0f73e77dacc None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.502694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.508569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 489/975] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:30.516731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:30.541129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:30.568351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.570819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.570819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.571203 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.585039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.588248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:30.627854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:30.629992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:30.631686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 487/976] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:26:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:30.640360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:30.672552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6a471-dadb-4dad-aba1-1dab997c1d3e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.684588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:30.717847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f827b-f5c5-4e1c-a120-4b29c14f9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.718389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f827b-f5c5-4e1c-a120-4b29c14f9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.718722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f827b-f5c5-4e1c-a120-4b29c14f9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.718942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f827b-f5c5-4e1c-a120-4b29c14f9bb7 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.719946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f827b-f5c5-4e1c-a120-4b29c14f9bb7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:30.720648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f827b-f5c5-4e1c-a120-4b29c14f9bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.721964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f827b-f5c5-4e1c-a120-4b29c14f9bb7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.734170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 490/977] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:30.737209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf7bc-bbf1-4a17-85d7-daa60a847808 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.737561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf7bc-bbf1-4a17-85d7-daa60a847808 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.737869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf7bc-bbf1-4a17-85d7-daa60a847808 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.744468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 491/978] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:30.744468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf7bc-bbf1-4a17-85d7-daa60a847808 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:30.777341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5196aa-aa14-4c54-aa26-5ceada101690 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.821207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3488fc5-3ee8-4392-ae14-c025057e0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.821966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3488fc5-3ee8-4392-ae14-c025057e0417 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.822256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3488fc5-3ee8-4392-ae14-c025057e0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.822545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3488fc5-3ee8-4392-ae14-c025057e0417 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.823417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3488fc5-3ee8-4392-ae14-c025057e0417 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:30.823733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3488fc5-3ee8-4392-ae14-c025057e0417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.825208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3488fc5-3ee8-4392-ae14-c025057e0417 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:30.844754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:30.881812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 488/979] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 08:26:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:30.881812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd35d8-e2b0-4824-8dd1-f41149f542b2 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.881812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd35d8-e2b0-4824-8dd1-f41149f542b2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.881812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd35d8-e2b0-4824-8dd1-f41149f542b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.896321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf7bc-bbf1-4a17-85d7-daa60a847808 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:30.910522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-70fd35d8-e2b0-4824-8dd1-f41149f542b2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:30.912363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-70fd35d8-e2b0-4824-8dd1-f41149f542b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:30.970236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa625c-e752-4249-933d-e06796be99a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:30.970941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa625c-e752-4249-933d-e06796be99a4 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:30.971231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa625c-e752-4249-933d-e06796be99a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:30.971520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa625c-e752-4249-933d-e06796be99a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:30.973300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa625c-e752-4249-933d-e06796be99a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:30.975044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa625c-e752-4249-933d-e06796be99a4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:31.025560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 489/980] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:31.052223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd35d8-e2b0-4824-8dd1-f41149f542b2 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:31.062007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 492/981] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:31.099904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:31.220379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd35d8-e2b0-4824-8dd1-f41149f542b2 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:31.290304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca281f-1fa0-435b-b405-50e8a0a5acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:31.290982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca281f-1fa0-435b-b405-50e8a0a5acc0 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:31.291278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca281f-1fa0-435b-b405-50e8a0a5acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:31.291553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca281f-1fa0-435b-b405-50e8a0a5acc0 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:31.292311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca281f-1fa0-435b-b405-50e8a0a5acc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:31.293738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca281f-1fa0-435b-b405-50e8a0a5acc0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:31.363336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 490/982] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:26:31 2022] POST /identity/v3/services => generated 242 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:32.530961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2a68-ad48-43bf-885a-9d1109a6cd20 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:32.531708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2a68-ad48-43bf-885a-9d1109a6cd20 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:32.531708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2a68-ad48-43bf-885a-9d1109a6cd20 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:32.537731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 493/983] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:32.548861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a895-27ca-4346-8a28-2e171c0e3135 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:32.549616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a895-27ca-4346-8a28-2e171c0e3135 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:32.549910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a895-27ca-4346-8a28-2e171c0e3135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:32.579771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-14f6a895-27ca-4346-8a28-2e171c0e3135 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:32.581905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-14f6a895-27ca-4346-8a28-2e171c0e3135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:32.697713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 491/984] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:32.716795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea2a68-ad48-43bf-885a-9d1109a6cd20 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:32.897115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea2a68-ad48-43bf-885a-9d1109a6cd20 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:32.956237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:32.957585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:32.958115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:32.958621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:32.959852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:32.962495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:32.965946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:32.977536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:32.979560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:32.993371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 494/985] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jul 18 08:26:32 2022] GET /identity/v3/services/image => generated 86 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:32.994224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a895-27ca-4346-8a28-2e171c0e3135 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:32.994224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:33.103563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a895-27ca-4346-8a28-2e171c0e3135 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:33.140753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f72b8-d876-494c-bcdf-eb375cd38d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:33.141426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f72b8-d876-494c-bcdf-eb375cd38d37 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.142274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f72b8-d876-494c-bcdf-eb375cd38d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.142524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f72b8-d876-494c-bcdf-eb375cd38d37 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.143239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f72b8-d876-494c-bcdf-eb375cd38d37 None admin] RBAC: Adding query filter params (name=image) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:33.143549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f72b8-d876-494c-bcdf-eb375cd38d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:33.144941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f72b8-d876-494c-bcdf-eb375cd38d37 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:33.154446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 492/986] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:33.161166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:33.215581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cc50-b49f-42fd-b333-92b8e7af6aed None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.215907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cc50-b49f-42fd-b333-92b8e7af6aed None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.216142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cc50-b49f-42fd-b333-92b8e7af6aed None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.217703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 493/987] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:33.224249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49569a-5a58-4b0e-b37c-b913c34e1843 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.224526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49569a-5a58-4b0e-b37c-b913c34e1843 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.224824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49569a-5a58-4b0e-b37c-b913c34e1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.244499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6f49569a-5a58-4b0e-b37c-b913c34e1843 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:33.245713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6f49569a-5a58-4b0e-b37c-b913c34e1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:33.293087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3b74c-5e10-4796-bf37-bb35d9b16ba1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:33.316544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:33.324500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 494/988] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:33.348685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49569a-5a58-4b0e-b37c-b913c34e1843 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:33.353090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:33.353975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.354576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.355077 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.356386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] RBAC: Adding query filter params (type=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:33.356979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:33.359530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:33.367556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 495/989] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:33.476265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49569a-5a58-4b0e-b37c-b913c34e1843 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:33.518303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147646d-0f94-45d4-a8bb-3716be5359b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:33.521906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147646d-0f94-45d4-a8bb-3716be5359b8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.521906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147646d-0f94-45d4-a8bb-3716be5359b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.521906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147646d-0f94-45d4-a8bb-3716be5359b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.521906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147646d-0f94-45d4-a8bb-3716be5359b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:33.521906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147646d-0f94-45d4-a8bb-3716be5359b8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-f147646d-0f94-45d4-a8bb-3716be5359b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:33.538344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:33.539416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:33.540305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 495/990] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:33.546161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:33.635314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:33.692686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f9df-2d03-4c94-b941-2f0f58af8123 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:33.702837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4456fe-0088-4aa3-bb09-cf3bc1b84085 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.703591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4456fe-0088-4aa3-bb09-cf3bc1b84085 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.703591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4456fe-0088-4aa3-bb09-cf3bc1b84085 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.705377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 496/991] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:33.711001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56a90-5e96-49a4-a9b4-b2550e748594 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.711285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56a90-5e96-49a4-a9b4-b2550e748594 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.711585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56a90-5e96-49a4-a9b4-b2550e748594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.734776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-77c56a90-5e96-49a4-a9b4-b2550e748594 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:33.736941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-77c56a90-5e96-49a4-a9b4-b2550e748594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:33.737124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:33.737846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.738134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.738415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.739159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:33.739443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:33.740835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:33.746947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 496/992] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:33.753551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:33.837064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:33.851981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 497/993] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:33.874583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c56a90-5e96-49a4-a9b4-b2550e748594 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:33.894852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4350588-0082-4e3c-95ca-26c1d18dc347 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:33.936482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:33.947241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:33.948213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:33.948501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:33.949548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:33.950165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:33.950481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:33.952043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:33.958415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 497/994] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:33.965982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:33.999101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c56a90-5e96-49a4-a9b4-b2550e748594 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:34.041802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:34.042619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:34.042911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:34.043208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:34.043857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:34.045261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:34.057899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:34.059010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:34.059857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 498/995] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:34.066580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:34.117794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724bad6-39b9-4aa0-9ef8-42358a012608 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:34.156300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:34.177181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:34.178408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:34.178913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:34.179406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:34.180927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] RBAC: Adding query filter params (interface=admin, service_id=0912226d006a4eca8e29d5c32a337c83, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:34.181324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:34.184044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:34.194383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 498/996] 10.222.0.39 () {56 vars in 1249 bytes} [Mon Jul 18 08:26:33 2022] GET /identity/v3/endpoints?service_id=0912226d006a4eca8e29d5c32a337c83&interface=admin®ion_id=RegionOne => generated 193 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:34.199976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:34.220009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512cb19-8a73-45cf-8fe7-cebe9cbe77bc None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:34.263241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:34.263837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:34.264126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:34.264396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:34.265127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:34.265435 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:34.267413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:34.279313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 499/997] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:34.280453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:34.284986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:34.336060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650efb35-a178-466c-acc2-8ef28ef9dc54 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:34.380628 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:34.381361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:34.381661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:34.382026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:34.382766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:34.384309 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:34.391606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 499/998] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:34 2022] GET /identity/v3/services => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:26:34.451691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a9826-4557-429d-9c3d-8526d38dfc03 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:34.495252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:34.526876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:34.527787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:34.528300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:34.528810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:34.530138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:34.531286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:34.534197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:34.544764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 500/999] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:34.547071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:34.694536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922693e-3752-44de-81d0-64719d81ada5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:34.715869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:34.745202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f986698-f62c-4b1f-a863-2be28a056381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:34.746403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986698-f62c-4b1f-a863-2be28a056381 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:34.746906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986698-f62c-4b1f-a863-2be28a056381 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:34.747418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986698-f62c-4b1f-a863-2be28a056381 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:34.749447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f986698-f62c-4b1f-a863-2be28a056381 None admin] RBAC: Adding query filter params (interface=public, service_id=36fa755736564b6eb9ed65687b26c5b0, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:34.750298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f986698-f62c-4b1f-a863-2be28a056381 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:34.754872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f986698-f62c-4b1f-a863-2be28a056381 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:34.765631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 500/1000] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:26:34 2022] GET /identity/v3/endpoints?service_id=36fa755736564b6eb9ed65687b26c5b0&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:34.775585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:34.929482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04f251-c989-42b3-98a0-33690a99a384 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:34.982981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a57d40-7f5c-4688-8f59-62273a09e989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:34.984109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57d40-7f5c-4688-8f59-62273a09e989 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:34.984635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57d40-7f5c-4688-8f59-62273a09e989 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:34.985407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57d40-7f5c-4688-8f59-62273a09e989 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:34.986880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a57d40-7f5c-4688-8f59-62273a09e989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:34.989456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a57d40-7f5c-4688-8f59-62273a09e989 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:35.005336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 501/1001] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:34 2022] GET /identity/v3/services => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:26:35.529638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c16d-4170-47c9-ba9d-222579bae08c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:35.529975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c16d-4170-47c9-ba9d-222579bae08c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:35.530245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c16d-4170-47c9-ba9d-222579bae08c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:35.533847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 501/1002] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:35.541387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ed21-fa08-4e32-ae05-fec812bfeb14 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:35.541947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ed21-fa08-4e32-ae05-fec812bfeb14 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:35.542439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ed21-fa08-4e32-ae05-fec812bfeb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:35.565218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d115ed21-fa08-4e32-ae05-fec812bfeb14 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:35.566610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d115ed21-fa08-4e32-ae05-fec812bfeb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:35.621482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:35.649202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 502/1003] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:35.672060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799c16d-4170-47c9-ba9d-222579bae08c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:35.846981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799c16d-4170-47c9-ba9d-222579bae08c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:35.907839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784d68-05fc-4623-93be-e62730f75779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:35.908994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784d68-05fc-4623-93be-e62730f75779 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:35.909486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784d68-05fc-4623-93be-e62730f75779 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:35.910124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784d68-05fc-4623-93be-e62730f75779 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:35.911560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784d68-05fc-4623-93be-e62730f75779 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:35.914159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784d68-05fc-4623-93be-e62730f75779 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:36.003005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 502/1004] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:26:35 2022] POST /identity/v3/services => generated 242 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:36.533545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7a6b3-cb86-4201-97be-10020cbeec39 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:36.534384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7a6b3-cb86-4201-97be-10020cbeec39 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:36.534384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7a6b3-cb86-4201-97be-10020cbeec39 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:36.537707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 503/1005] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:36.544853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb13a-e612-448b-af99-57fbf4d5b60c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:36.545353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb13a-e612-448b-af99-57fbf4d5b60c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:36.545888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb13a-e612-448b-af99-57fbf4d5b60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:36.573422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a23bb13a-e612-448b-af99-57fbf4d5b60c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:36.574771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a23bb13a-e612-448b-af99-57fbf4d5b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:36.620391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:36.669711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 503/1006] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:36 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:36.707060 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7a6b3-cb86-4201-97be-10020cbeec39 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:36.892568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7a6b3-cb86-4201-97be-10020cbeec39 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:36.955034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:36.956421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:36.956908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:36.957394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:36.958656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:36.961183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:36.984358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:36.987038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 08:26:36.987899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:36.989470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 504/1007] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 08:26:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:36.997124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb13a-e612-448b-af99-57fbf4d5b60c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:37.126739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb13a-e612-448b-af99-57fbf4d5b60c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:37.169267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc59d-ae97-4d2b-9cab-44fdad03d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:37.169903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc59d-ae97-4d2b-9cab-44fdad03d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:37.170181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc59d-ae97-4d2b-9cab-44fdad03d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:37.170451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc59d-ae97-4d2b-9cab-44fdad03d1f0 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:37.171168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc59d-ae97-4d2b-9cab-44fdad03d1f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:37.171471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc59d-ae97-4d2b-9cab-44fdad03d1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:37.174364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc59d-ae97-4d2b-9cab-44fdad03d1f0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:37.180141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 504/1008] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:37.185983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:37.253016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:37.276488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b7cd-e866-460b-982b-6f5371ef9b42 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:37.276985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b7cd-e866-460b-982b-6f5371ef9b42 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:37.277479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b7cd-e866-460b-982b-6f5371ef9b42 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:37.280103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 505/1009] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:37.287641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536ddc-7156-47bc-96e6-96fccf9cdd26 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:37.288120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536ddc-7156-47bc-96e6-96fccf9cdd26 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:37.288615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536ddc-7156-47bc-96e6-96fccf9cdd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:37.313905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-01536ddc-7156-47bc-96e6-96fccf9cdd26 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:37.320862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-01536ddc-7156-47bc-96e6-96fccf9cdd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:37.330971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13406383-b749-4b3b-9313-c304d6461990 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:37.356975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:37.379204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:37.380381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:37.380886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:37.381390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:37.382803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:37.383360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:37.386017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:37.401323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 505/1010] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 08:26:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:37.403567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:37.424919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 506/1011] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:37 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:37.464199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536ddc-7156-47bc-96e6-96fccf9cdd26 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:37.550075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4aae6-e00b-46a4-85e4-55cf842da516 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:37.563784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:37.605363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536ddc-7156-47bc-96e6-96fccf9cdd26 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:37.606704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:37.607469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:37.607759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:37.608210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:37.609007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:37.611403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:37.669814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:37.671071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:37.671580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:37.672114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:37.673627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:37.678926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:37.694404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:37.695616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:37.697342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 507/1012] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:37.705633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:37.712718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 506/1013] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:26:37.754651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:37.846849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6302bb-59fb-41ee-a740-84de8a7368cf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:37.900392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:37.901076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:37.901359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:37.901639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:37.902394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:37.902698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:37.904088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:37.910423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 508/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:37.916294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:38.047853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eb7de-e39e-4a48-b266-84dfcdf30a18 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:38.099414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2239b-67d6-48c4-a424-82f9cf5d7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:38.100126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2239b-67d6-48c4-a424-82f9cf5d7af1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:38.100504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2239b-67d6-48c4-a424-82f9cf5d7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:38.100849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2239b-67d6-48c4-a424-82f9cf5d7af1 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:38.101595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2239b-67d6-48c4-a424-82f9cf5d7af1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:38.102042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2239b-67d6-48c4-a424-82f9cf5d7af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:38.103657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2239b-67d6-48c4-a424-82f9cf5d7af1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:38.111659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 507/1015] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 08:26:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:38.118272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:38.124369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598fbff-7134-4ed8-b508-4ab70044d8f3 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:38.124633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598fbff-7134-4ed8-b508-4ab70044d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:38.124941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598fbff-7134-4ed8-b508-4ab70044d8f3 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:38.127163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 508/1016] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:38.132905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f75c0-a197-42a8-9b2d-8242be58240f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:38.133236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f75c0-a197-42a8-9b2d-8242be58240f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:38.133470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f75c0-a197-42a8-9b2d-8242be58240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:38.151817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4e0f75c0-a197-42a8-9b2d-8242be58240f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:38.153038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4e0f75c0-a197-42a8-9b2d-8242be58240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:38.183180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:38.235486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 509/1017] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:38 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:38.239722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:38.258701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3864-b521-499a-b0d6-f6be8f85f560 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:38.259687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f75c0-a197-42a8-9b2d-8242be58240f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:38.297448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:38.299153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:38.299573 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:38.299872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:38.300634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:38.302069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:38.386264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 509/1018] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:38.445343 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f75c0-a197-42a8-9b2d-8242be58240f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:38.526968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:38.528375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:38.528876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:38.529378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:38.530417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:38.533179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:38.557162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:38.558935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:38.559987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 510/1019] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jul 18 08:26:38 2022] GET /identity/v3/services/image => generated 86 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:38.566365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:38.727664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4b0f5-64ca-4ed6-b3f7-1d9396b5d7ac None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:38.772175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:38.772900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:38.773387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:38.773735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:38.774550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] RBAC: Adding query filter params (name=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:38.774973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:38.776535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:38.789811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 510/1020] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:38.794049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:38.823555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:38.935004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195873-d01d-40f4-b4e5-70eddb35c0f8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:38.974374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:38.975318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:38.975752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:38.976205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:38.977079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] RBAC: Adding query filter params (type=image) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:38.977533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:38.979098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:38.989851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 511/1021] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:38.991534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:39.002856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:39.103875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24406e0f-0e3b-40a6-b056-50e266e75819 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:39.140266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed26adb-4b0f-4e18-9fde-a0507c81b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:39.142263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26adb-4b0f-4e18-9fde-a0507c81b039 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:39.142764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26adb-4b0f-4e18-9fde-a0507c81b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:39.143187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26adb-4b0f-4e18-9fde-a0507c81b039 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:39.144162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed26adb-4b0f-4e18-9fde-a0507c81b039 None admin] RBAC: Adding query filter params (interface=public, service_id=be83edc498a04b5a8d738b66353a8c34, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:39.144709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed26adb-4b0f-4e18-9fde-a0507c81b039 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:39.146330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed26adb-4b0f-4e18-9fde-a0507c81b039 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:39.152566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 511/1022] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:26:38 2022] GET /identity/v3/endpoints?service_id=be83edc498a04b5a8d738b66353a8c34&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:39.159102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:39.263785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:39.291094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afc8c6-7467-4c83-839b-4a89566a1483 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:39.331877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddf4a1-27f8-4b52-bf91-9d007dfb3025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:39.332564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddf4a1-27f8-4b52-bf91-9d007dfb3025 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:39.332908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddf4a1-27f8-4b52-bf91-9d007dfb3025 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:39.333195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddf4a1-27f8-4b52-bf91-9d007dfb3025 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:39.333979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddf4a1-27f8-4b52-bf91-9d007dfb3025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:39.335387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddf4a1-27f8-4b52-bf91-9d007dfb3025 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:39.349996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 512/1023] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:26:39 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:26:40.633469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c55f5-e29e-4089-9eda-3f4402a5eb73 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:40.634303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c55f5-e29e-4089-9eda-3f4402a5eb73 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:40.634637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c55f5-e29e-4089-9eda-3f4402a5eb73 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:40.637347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 512/1024] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:40.646969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fe75-9654-44ac-963f-c8c3330d4694 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:40.647571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fe75-9654-44ac-963f-c8c3330d4694 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:40.647945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fe75-9654-44ac-963f-c8c3330d4694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:40.672148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ce35fe75-9654-44ac-963f-c8c3330d4694 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:40.673961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ce35fe75-9654-44ac-963f-c8c3330d4694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:40.680610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef9e96-02a4-48fb-91ec-0c2f97887885 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:40.680884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef9e96-02a4-48fb-91ec-0c2f97887885 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:40.681206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef9e96-02a4-48fb-91ec-0c2f97887885 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:40.682792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 513/1025] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:40.688120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6940b-ad84-4a26-ba18-f0628a4c83c3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:40.689020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6940b-ad84-4a26-ba18-f0628a4c83c3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:40.689216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6940b-ad84-4a26-ba18-f0628a4c83c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:40.711044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a9b6940b-ad84-4a26-ba18-f0628a4c83c3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:40.712912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a9b6940b-ad84-4a26-ba18-f0628a4c83c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:40.789597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 513/1026] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:40.822188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:40.829080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35fe75-9654-44ac-963f-c8c3330d4694 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:40.833973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 514/1027] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:40.861386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6940b-ad84-4a26-ba18-f0628a4c83c3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:40.924745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:40.958073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35fe75-9654-44ac-963f-c8c3330d4694 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.003340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.004340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.004853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.005335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.007674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:41.009993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:41.017749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 514/1028] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:41.018020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6940b-ad84-4a26-ba18-f0628a4c83c3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.020369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:41.067089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.067926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.068212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.068490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.083873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:41.100541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:41.101809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:41.102899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:41.103560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 515/1029] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 08:26:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:41.112315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:41.185431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4321fb-9811-4fb3-adba-8ff08736e75b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.202285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:41.228602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.229296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.229583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.229882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.230615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:41.232135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:41.267997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6175f-89bf-481c-a3d6-a327865507f5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.324701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.325643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.326139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.326543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.327472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:41.327960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:41.328545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:41.330934 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:41.345082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 515/1030] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:26:41 2022] POST /identity/v3/projects => generated 311 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:41.345368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 516/1031] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 08:26:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:41.348941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:41.477155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a46786-d986-4ec4-acc6-0ede5cecb198 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.528467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baae5d-b7f3-42fe-a0d3-433d3bf30bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.529297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baae5d-b7f3-42fe-a0d3-433d3bf30bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.529580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baae5d-b7f3-42fe-a0d3-433d3bf30bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.529881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baae5d-b7f3-42fe-a0d3-433d3bf30bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.543746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baae5d-b7f3-42fe-a0d3-433d3bf30bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:41.545266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baae5d-b7f3-42fe-a0d3-433d3bf30bc4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-c9baae5d-b7f3-42fe-a0d3-433d3bf30bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:41.566603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:41.567606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:41.573495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:41.573495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:41.573495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:41.573495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:41.573495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 516/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:41.575459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:41.650632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658e848-ca22-46de-9ed9-ce91c2e846d3 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.651155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658e848-ca22-46de-9ed9-ce91c2e846d3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.651265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658e848-ca22-46de-9ed9-ce91c2e846d3 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.652613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 517/1033] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:41.660129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462af12-e191-4c54-8895-961b92dd45ae None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.660460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462af12-e191-4c54-8895-961b92dd45ae None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.660696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462af12-e191-4c54-8895-961b92dd45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.680116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d462af12-e191-4c54-8895-961b92dd45ae None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:41.681349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d462af12-e191-4c54-8895-961b92dd45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:41.722408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d348-31e0-4f7a-a042-64136c9d1441 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.751393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:41.753836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:41.769426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.770224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.770510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.770792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.771537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:41.771840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:41.774171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:41.777202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 518/1034] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:41.801467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 517/1035] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:41.802168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462af12-e191-4c54-8895-961b92dd45ae None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:41.803176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:41.928085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa97f44-9812-4f64-be8d-d19ee4429bf1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.950327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462af12-e191-4c54-8895-961b92dd45ae None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:41.990037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.991341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.991653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.991761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:41.992158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.992454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:41.992737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:41.993017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] PATH_INFO: `/v3/services/image` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:41.995453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:41.995453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.007486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:42.008741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:42.013982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 08:26:42.014909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:42.015920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.016006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 519/1036] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jul 18 08:26:41 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:42.018025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:42.031458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:42.032653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:42.033631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:42.037855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 518/1037] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:26:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:42.039518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:42.087697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:42.107365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:42.164512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccfe80-af28-46fa-b46a-372feed6e635 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:42.179306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a191-301d-439c-9601-5c1c9991afcb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:42.210184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:42.211009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:42.211457 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:42.211913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:42.212734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:42.213035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:42.214511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.221263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 520/1038] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:42.227934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:42.229589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:42.230378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:42.232720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:42.232720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:42.232720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:42.232720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:42.233607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.268046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 519/1039] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:26:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:42.269816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:42.370056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21e907-5191-4c1b-ab48-52a1a67e60a9 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:42.381227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:42.408458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:42.408951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:42.409139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:42.409414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:42.409708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:42.410443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] RBAC: Adding query filter params (type=image) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:42.410749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:42.412168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.412516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a2ea-73c1-42c2-a6a9-c39d68a112bb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:42.419175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 521/1040] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:42.425999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:42.457010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:42.457754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:42.458035 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:42.458356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:42.558167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:42.559676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.562449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230aeba-4558-4994-b956-d3e62ffac85e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:42.623407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:42.624472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:42.624935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:42.625912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:42.627267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:42.629620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.696738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:42.700711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 520/1041] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 08:26:42.713326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:42.713575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 522/1042] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:26:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:42.857379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecf276-70fe-4461-9ace-78f5a7aed45a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:42.916504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:42.917308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:42.917590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:42.917904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:42.930098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:42.931553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:42.952342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:42.953327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:42.954578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:42.954578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:42.954578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:42.954578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:42.954578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 521/1043] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:42.962775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:43.002585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:43.099098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8fe8-790b-4221-9ccb-a2289537cd2c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:43.145008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:43.145730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:43.146021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:43.146352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:43.147329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:43.147740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:43.149395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:43.165461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 523/1044] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:43.173060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:43.235116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:43.293496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9417-ded5-4b10-a903-0820235ba4c7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:43.333091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:43.334001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:43.334286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:43.334558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:43.343130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:43.345254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:43.369758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:43.371549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:43.373175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:43.377232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 522/1045] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:43.378808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:43.501178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:43.524691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de1e7a-d117-45c1-a4ad-8b1731fec7a7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:43.589992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc300f-1258-4e8d-ad64-f774b03ab8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:43.591132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc300f-1258-4e8d-ad64-f774b03ab8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:43.591638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc300f-1258-4e8d-ad64-f774b03ab8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:43.592386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc300f-1258-4e8d-ad64-f774b03ab8a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:43.593968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc300f-1258-4e8d-ad64-f774b03ab8a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:43.594853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc300f-1258-4e8d-ad64-f774b03ab8a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:43.596521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc300f-1258-4e8d-ad64-f774b03ab8a1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:43.625011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 524/1046] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:43.627509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:43.691807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb813df1-9e1c-4b3c-8d3f-9ec479f9f7c4 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:43.692466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb813df1-9e1c-4b3c-8d3f-9ec479f9f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:43.692940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb813df1-9e1c-4b3c-8d3f-9ec479f9f7c4 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:43.697327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 525/1047] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:43.705490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1d66-232a-483e-918a-c55960177b19 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:43.706039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1d66-232a-483e-918a-c55960177b19 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:43.706535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1d66-232a-483e-918a-c55960177b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:43.737008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1a2c1d66-232a-483e-918a-c55960177b19 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:43.738052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1a2c1d66-232a-483e-918a-c55960177b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:43.788451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6bb89-b101-4526-8e0a-7d3e41d6c791 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:43.802150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:43.829194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 526/1048] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:43.838351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:43.839026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:43.839319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:43.839578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:43.840510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] RBAC: Adding query filter params (role.id=5e23b51b6b3048eeb871200df496698d, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=df173c85777f45dd8ed9fb11bad366b2) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:43.840774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:43.842249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:43.857761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 523/1049] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:43 2022] GET /identity/v3/role_assignments?user.id=df173c85777f45dd8ed9fb11bad366b2&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=5e23b51b6b3048eeb871200df496698d => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:43.864090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c1d66-232a-483e-918a-c55960177b19 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:43.996323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:44.035925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c1d66-232a-483e-918a-c55960177b19 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:44.082963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764638-ebca-4434-aba2-9d05da6d94a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:44.083777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764638-ebca-4434-aba2-9d05da6d94a0 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:44.084059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764638-ebca-4434-aba2-9d05da6d94a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:44.084334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764638-ebca-4434-aba2-9d05da6d94a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:44.085584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11764638-ebca-4434-aba2-9d05da6d94a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:44.087094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11764638-ebca-4434-aba2-9d05da6d94a0 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:44.089033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 527/1050] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:44.095271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:44.208381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cc106-fb08-4fdc-b90f-c358f62f52ee None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:44.246435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6608b-b513-4f8e-ac3d-54459e917afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:44.247114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6608b-b513-4f8e-ac3d-54459e917afc None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:44.247396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6608b-b513-4f8e-ac3d-54459e917afc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:44.247677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6608b-b513-4f8e-ac3d-54459e917afc None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:44.248416 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6608b-b513-4f8e-ac3d-54459e917afc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:44.249901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6608b-b513-4f8e-ac3d-54459e917afc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:44.369800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 524/1051] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:26:44 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:44.945248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028410a-fdfa-47c8-a352-707af34920c4 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:44.946052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028410a-fdfa-47c8-a352-707af34920c4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:44.946052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028410a-fdfa-47c8-a352-707af34920c4 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:44.947564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 528/1052] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:44.953148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4ab3-9300-4bff-8374-b75764238c59 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:44.953913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4ab3-9300-4bff-8374-b75764238c59 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:44.953913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4ab3-9300-4bff-8374-b75764238c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:44.972458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5a6c4ab3-9300-4bff-8374-b75764238c59 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:44.973705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5a6c4ab3-9300-4bff-8374-b75764238c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:45.001848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:45.060574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 525/1053] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:45.091067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028410a-fdfa-47c8-a352-707af34920c4 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:45.239455 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028410a-fdfa-47c8-a352-707af34920c4 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:45.288876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:45.289828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:45.290192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:45.290713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:45.316066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:45.381842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:45.383380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:45.565797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 529/1054] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:45.571676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4ab3-9300-4bff-8374-b75764238c59 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:45.701248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4ab3-9300-4bff-8374-b75764238c59 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:45.756052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200fdf6-370d-444a-82fd-cad0ad5ef333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:45.757278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200fdf6-370d-444a-82fd-cad0ad5ef333 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:45.757735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200fdf6-370d-444a-82fd-cad0ad5ef333 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:45.758161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200fdf6-370d-444a-82fd-cad0ad5ef333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:45.777821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200fdf6-370d-444a-82fd-cad0ad5ef333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:45.780178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200fdf6-370d-444a-82fd-cad0ad5ef333 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8200fdf6-370d-444a-82fd-cad0ad5ef333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:45.811888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:45.813427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:45.820409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:45.820409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:45.820409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:45.820409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:45.820409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 526/1055] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:45.821467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:45.901109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:45.981782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaf0f-7592-451f-b949-5db2b87fec0f None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:46.028273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb6f1-5211-4841-bf45-6f7461d12ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:46.028833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb6f1-5211-4841-bf45-6f7461d12ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.029114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb6f1-5211-4841-bf45-6f7461d12ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.029414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb6f1-5211-4841-bf45-6f7461d12ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.030275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb6f1-5211-4841-bf45-6f7461d12ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:46.030574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb6f1-5211-4841-bf45-6f7461d12ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:46.032677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb6f1-5211-4841-bf45-6f7461d12ad9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:46.045942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 530/1056] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:46.142610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cca9a-4c05-49d3-ab73-a337deaacdc8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.143363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cca9a-4c05-49d3-ab73-a337deaacdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.143363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cca9a-4c05-49d3-ab73-a337deaacdc8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.144809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 527/1057] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:46.150555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960f1e1-7b3a-496e-915a-defbd007ecc1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.150950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960f1e1-7b3a-496e-915a-defbd007ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.151180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960f1e1-7b3a-496e-915a-defbd007ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.170501 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f960f1e1-7b3a-496e-915a-defbd007ecc1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:46.171739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f960f1e1-7b3a-496e-915a-defbd007ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:46.263372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 531/1058] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:26:46.288014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cca9a-4c05-49d3-ab73-a337deaacdc8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:46.307679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:46.413404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cca9a-4c05-49d3-ab73-a337deaacdc8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:46.447861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3115cef-6b18-4fcc-9875-5cee68368344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:46.448670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3115cef-6b18-4fcc-9875-5cee68368344 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.448956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3115cef-6b18-4fcc-9875-5cee68368344 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.449228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3115cef-6b18-4fcc-9875-5cee68368344 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.460283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3115cef-6b18-4fcc-9875-5cee68368344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d3115cef-6b18-4fcc-9875-5cee68368344 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:46.469761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:46.471577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:46.472656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:46.473811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 528/1059] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 08:26:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:46.477067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960f1e1-7b3a-496e-915a-defbd007ecc1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:46.512529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:46.588596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960f1e1-7b3a-496e-915a-defbd007ecc1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:46.627482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:46.628179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.628464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.628742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.629536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:46.629876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:46.631328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:46.636523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de5a-ae24-4360-8044-2be89e5064d7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.636811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de5a-ae24-4360-8044-2be89e5064d7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.637089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de5a-ae24-4360-8044-2be89e5064d7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.638538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 529/1060] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:46.643275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 532/1061] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 08:26:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:46.644595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20eecc-1ecb-4ad2-908e-f772c6598d64 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.644887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20eecc-1ecb-4ad2-908e-f772c6598d64 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.645164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20eecc-1ecb-4ad2-908e-f772c6598d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.647515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:46.662884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ea20eecc-1ecb-4ad2-908e-f772c6598d64 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:46.664104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ea20eecc-1ecb-4ad2-908e-f772c6598d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:46.735885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:46.740618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 530/1062] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:46.755284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:46.759641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766c2c-832c-49c8-b24f-51d20f6936c1 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:46.764100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20eecc-1ecb-4ad2-908e-f772c6598d64 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:46.801028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:46.803299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.803573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.803852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.814578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:46.816040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:46.835015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:46.836807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:46.838353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:46.838353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:46.838353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:46.838353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:46.838353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 533/1063] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:46.842426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:46.877464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20eecc-1ecb-4ad2-908e-f772c6598d64 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:46.917401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:46.918565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:46.918933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:46.919445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:46.938853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:46.952364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:46.955644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:46.959451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 531/1064] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:46.962569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:46.991802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e284656-4002-456f-b28c-c500196b03c6 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.037525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:47.045456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.051224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.051224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.051224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.051224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:47.051224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.051224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.069207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 534/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:47.070387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.083454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:47.111455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b81d93-e201-4133-9853-d97fab169632 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.155128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.155794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.156079 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.156353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.157634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:47.157977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.159379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.169556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 532/1066] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:47.176085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.213852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48aa2f-24f6-4ef9-87a0-799dfd11596f None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.270278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.271094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.271392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.271649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.280039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.281290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f1524-3e57-4061-862e-c919b829cb59 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.282076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:47.297746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:47.299735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:47.301297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 535/1067] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:47.305090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.306872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:47.321549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.322578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.322868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.323147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] PATH_INFO: `/v3/users/99fd297f6ef3454bb5b573330b76ac92` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.339447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] RBAC: Authorizing `identity:get_user(user_id=99fd297f6ef3454bb5b573330b76ac92)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.341251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.348387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 533/1068] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/users/99fd297f6ef3454bb5b573330b76ac92 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:47.350662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.381326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:47.414744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce11f0-6f0b-4459-9e20-02640aec4e98 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.451053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.451749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.452033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.452314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.453166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:47.454030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.455731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.478171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 536/1069] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:47.484580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.508252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb28a-bcdb-4923-a5a0-f126fd3803e4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.565225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.565928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.566217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.566526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.601631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b7bd-0106-4dfd-9495-635bcf2edb0a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.630057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:47.633622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:47.642577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.645921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.645921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.645921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.654665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.656132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.664252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.667183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:47.676476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:47.678633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:47.680052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:47.680052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:47.680052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:47.680052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:47.680052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 537/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:47.683865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.795435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 534/1071] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 08:26:47.802069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.833535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cc0a2-6a9a-4945-a888-b3666541edd7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.884251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.885322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.885879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.886386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.887724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:47.888278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.890783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.899202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:47.911838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 538/1072] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:47.918086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.920522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abeed9-033b-4973-adc9-c0beec32eb40 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:47.959489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:47.960351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:47.960638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:47.960913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:47.962200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] RBAC: Authorizing `identity:get_project(project_id=041d83b221e446929f4b37b6013aa024)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:47.963647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:47.965388 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 535/1073] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/projects/041d83b221e446929f4b37b6013aa024 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:47.971732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:47.973530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:48.048600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2e92f-e350-42fc-bf59-6a33f2ac0b7d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:48.086045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:48.086854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:48.087141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:48.087417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:48.094561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b50916-9225-41f8-91af-dc38bbeacb34 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:48.095167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:48.096649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:48.112595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:48.113641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:48.114579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 539/1074] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:48.119784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:48.136398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:48.137010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:48.137303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:48.137573 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:48.138450 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=041d83b221e446929f4b37b6013aa024, user.id=99fd297f6ef3454bb5b573330b76ac92) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:48.138768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:48.140214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:48.147135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 536/1075] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:47 2022] GET /identity/v3/role_assignments?user.id=99fd297f6ef3454bb5b573330b76ac92&scope.project.id=041d83b221e446929f4b37b6013aa024&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:48.240516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:48.245783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb92d-22cd-43e9-a21f-c895b51a57f4 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:48.286578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5422762-5b25-4551-b66c-6cef81184b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:48.287259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5422762-5b25-4551-b66c-6cef81184b1b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:48.287548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5422762-5b25-4551-b66c-6cef81184b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:48.287825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5422762-5b25-4551-b66c-6cef81184b1b None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:48.288648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5422762-5b25-4551-b66c-6cef81184b1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:48.288953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5422762-5b25-4551-b66c-6cef81184b1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:48.290492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5422762-5b25-4551-b66c-6cef81184b1b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:48.303970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 540/1076] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:48.310213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:48.327993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:48.448794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fea628-727b-4fdf-b97d-694345422e5f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:48.494630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b081d-2002-4faf-95d0-fd03c7fb9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:48.496044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b081d-2002-4faf-95d0-fd03c7fb9d75 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:48.496425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b081d-2002-4faf-95d0-fd03c7fb9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:48.496816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b081d-2002-4faf-95d0-fd03c7fb9d75 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/df173c85777f45dd8ed9fb11bad366b2/roles/5e23b51b6b3048eeb871200df496698d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:48.499968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b081d-2002-4faf-95d0-fd03c7fb9d75 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=df173c85777f45dd8ed9fb11bad366b2, role_id=5e23b51b6b3048eeb871200df496698d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:48.501991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b081d-2002-4faf-95d0-fd03c7fb9d75 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:48.561867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 537/1077] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:26:48 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/df173c85777f45dd8ed9fb11bad366b2/roles/5e23b51b6b3048eeb871200df496698d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:26:50.236987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c8e32-b587-41ea-9182-4ff991e69afd None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.237583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c8e32-b587-41ea-9182-4ff991e69afd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.237583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c8e32-b587-41ea-9182-4ff991e69afd None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.239013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 541/1078] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:26:50.245164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0fd9f-53c0-4946-90b4-987e687539af None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.245758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0fd9f-53c0-4946-90b4-987e687539af None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.245758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0fd9f-53c0-4946-90b4-987e687539af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.263712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-99c0fd9f-53c0-4946-90b4-987e687539af None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:50.265013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-99c0fd9f-53c0-4946-90b4-987e687539af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:50.340775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 538/1079] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:50.364412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c8e32-b587-41ea-9182-4ff991e69afd None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:50.477502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c8e32-b587-41ea-9182-4ff991e69afd None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:50.518857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f2c3a-130f-48a3-80ea-2593004ef6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:50.519576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2c3a-130f-48a3-80ea-2593004ef6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.519859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2c3a-130f-48a3-80ea-2593004ef6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.520136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2c3a-130f-48a3-80ea-2593004ef6a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.533377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f2c3a-130f-48a3-80ea-2593004ef6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-000f2c3a-130f-48a3-80ea-2593004ef6a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:50.541195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:50.542398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:50.543244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 542/1080] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:50.552161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0fd9f-53c0-4946-90b4-987e687539af None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:50.552366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:50.658319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8ed5-f0d5-4ae8-9d80-607a5b1c787b None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.658791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8ed5-f0d5-4ae8-9d80-607a5b1c787b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.659078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8ed5-f0d5-4ae8-9d80-607a5b1c787b None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.660807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 543/1081] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:50.661603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0fd9f-53c0-4946-90b4-987e687539af None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:50.667157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebc555-3c1c-43c0-832e-89454cf9496c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.667584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebc555-3c1c-43c0-832e-89454cf9496c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.667861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebc555-3c1c-43c0-832e-89454cf9496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.689420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-03ebc555-3c1c-43c0-832e-89454cf9496c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:50.690746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-03ebc555-3c1c-43c0-832e-89454cf9496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:50.698686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:50.699360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.699634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.699904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.700643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:50.700945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:50.702346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:50.706674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:50.711808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 539/1082] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:26:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:50.721148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:50.782802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 544/1083] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:50.791316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:50.806807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebc555-3c1c-43c0-832e-89454cf9496c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:50.833657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c47b0c-831c-4ef4-8868-ded2c925e191 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:50.871396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:50.872289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.872575 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.872855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] PATH_INFO: `/v3/users/99fd297f6ef3454bb5b573330b76ac92` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.874181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] RBAC: Authorizing `identity:get_user(user_id=99fd297f6ef3454bb5b573330b76ac92)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:50.876166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:50.878084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 540/1084] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:26:50 2022] GET /identity/v3/users/99fd297f6ef3454bb5b573330b76ac92 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:50.884161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:50.929606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebc555-3c1c-43c0-832e-89454cf9496c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:50.968780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:50.969840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:50.970128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:50.970409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:50.986046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:50.994437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:50.996167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:50.998554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 545/1085] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 08:26:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:26:51.002546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929eae55-ec5b-4333-b9b5-479209fb0fec None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:51.004542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:51.018629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:51.039343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:51.044092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:51.044962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:51.045240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:51.045560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:51.047333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] RBAC: Authorizing `identity:get_project(project_id=041d83b221e446929f4b37b6013aa024)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:51.048997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:51.051156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 541/1086] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:26:50 2022] GET /identity/v3/projects/041d83b221e446929f4b37b6013aa024 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:51.057606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:51.123222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb337-e333-4ce9-a025-a3210133f9d5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:51.164942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:51.165634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:51.165956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:51.166230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:51.167004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:51.167312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:51.168778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:51.178705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 546/1087] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 08:26:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:26:51.183973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279574be-8cdc-43c3-9442-d327a78704a3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:51.184972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:51.217178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:51.218111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:51.218390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:51.218693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024/users/99fd297f6ef3454bb5b573330b76ac92/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:51.220787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] RBAC: Authorizing `identity:create_grant(project_id=041d83b221e446929f4b37b6013aa024, user_id=99fd297f6ef3454bb5b573330b76ac92, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:51.222279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:51.262452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:51.287000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 542/1088] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:26:51 2022] PUT /identity/v3/projects/041d83b221e446929f4b37b6013aa024/users/99fd297f6ef3454bb5b573330b76ac92/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:26:51.295338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63419b85-89d6-4349-bc91-c5f96cf09b30 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:51.340332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:51.341164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:51.341443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:51.341750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:51.354487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:51.355979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:51.376640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:51.377821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:51.378726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:51.378726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:51.378726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:51.378726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:51.378726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 547/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:51.383929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:51.471607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:51.552931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bedbb-2459-4e19-b305-2bea4cafc158 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:51.587765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:51.588437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:51.588724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:51.589007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:51.589773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:51.590086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:51.591463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:51.604875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 543/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:51.611367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:51.711453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94968693-45ff-432c-be43-03689fbfe6a9 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:51.736051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:51.746579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:51.747371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:51.747652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:51.747925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:51.756270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:51.757744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:26:51.772543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:51.773761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:51.774805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 548/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 08:26:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:51.779953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:51.881503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628470b7-3af5-48d0-a51d-0e7c06892385 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:51.901981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:51.915660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:51.916333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:51.916616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:51.916888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:51.917744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:51.918055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:51.919486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:51.938728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 544/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 08:26:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:51.944452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:52.043748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e41752-c389-4481-a82b-c29fa5fe7a6a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:52.077034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:52.077688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:52.078050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:52.078326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:52.128917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:52.158022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:52.158022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:52.242480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 549/1093] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:52.248356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:52.351147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9de93-da18-46bd-9c25-30b6bc38aa52 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:52.385728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:52.386526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:52.386812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:52.387088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:52.397279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:52.398810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:26:52.418336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:52.419328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:52.420366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:26:52.420366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:26:52.420366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:26:52.420366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:52.420366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 545/1094] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:52.425917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:52.508214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:52.524838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9c5ac-0249-4877-a694-d5efea65bebc None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:52.560057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:52.560723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:52.561005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:52.561282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:52.562036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:52.562398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:52.564265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:52.575451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 550/1095] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:52.581197 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:52.611959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:52.681085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bed93-9734-40e4-90a5-33d6fdcdcf96 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:52.714844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:52.715645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:52.715931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:52.716210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:52.723127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:52.724580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:26:52.739359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:52.740307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:26:52.741379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 546/1096] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:52.746395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:52.850582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8ebb5-a130-4fa0-ae71-247b6b1d6eae None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:52.885849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e20c6-acfe-4da4-b280-6773054a3677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:52.886508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e20c6-acfe-4da4-b280-6773054a3677 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:52.886797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e20c6-acfe-4da4-b280-6773054a3677 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:52.887076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e20c6-acfe-4da4-b280-6773054a3677 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:52.887870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e20c6-acfe-4da4-b280-6773054a3677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:52.888179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e20c6-acfe-4da4-b280-6773054a3677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:52.889619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e20c6-acfe-4da4-b280-6773054a3677 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:52.902768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 551/1097] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:52.909538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:53.000884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:53.010233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30640-2d7b-442d-83f0-a935114f1212 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:53.044207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936e5af-aa20-45b5-be85-4627d004f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:53.044857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936e5af-aa20-45b5-be85-4627d004f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:53.045140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936e5af-aa20-45b5-be85-4627d004f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:53.045414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936e5af-aa20-45b5-be85-4627d004f1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:53.046283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936e5af-aa20-45b5-be85-4627d004f1c0 None admin] RBAC: Adding query filter params (role.id=5e23b51b6b3048eeb871200df496698d, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=df173c85777f45dd8ed9fb11bad366b2) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:53.046603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936e5af-aa20-45b5-be85-4627d004f1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:53.048181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936e5af-aa20-45b5-be85-4627d004f1c0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:53.054107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 547/1098] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:52 2022] GET /identity/v3/role_assignments?user.id=df173c85777f45dd8ed9fb11bad366b2&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=5e23b51b6b3048eeb871200df496698d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:53.315681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66e0ff-6954-451e-b91b-089e294a496c None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:53.315963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66e0ff-6954-451e-b91b-089e294a496c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:53.316236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66e0ff-6954-451e-b91b-089e294a496c None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:53.317919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 552/1099] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:53.323159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701686c3-ed97-4352-857a-91fd604c6b2a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:53.323452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701686c3-ed97-4352-857a-91fd604c6b2a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:53.323736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701686c3-ed97-4352-857a-91fd604c6b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:53.341927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-701686c3-ed97-4352-857a-91fd604c6b2a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:53.343119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-701686c3-ed97-4352-857a-91fd604c6b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:53.416755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 548/1100] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:53.440469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66e0ff-6954-451e-b91b-089e294a496c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:53.444689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:53.555095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66e0ff-6954-451e-b91b-089e294a496c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:53.591836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:53.592563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:53.592846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:53.593184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:53.605070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:26:53.613371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:26:53.614507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:26:53.615356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 553/1101] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:26:53.621017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701686c3-ed97-4352-857a-91fd604c6b2a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:53.713363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:53.730808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701686c3-ed97-4352-857a-91fd604c6b2a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:53.769368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:53.770081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:53.770358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:53.770630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:53.771387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:53.771691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:53.773072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:53.782533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 549/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:53.788760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:53.864886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:53.906796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0681ab-e137-42b5-91bf-ff64702ac193 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:53.943149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:53.944037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:53.944315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:53.944592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] PATH_INFO: `/v3/users/99fd297f6ef3454bb5b573330b76ac92` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:53.945848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] RBAC: Authorizing `identity:get_user(user_id=99fd297f6ef3454bb5b573330b76ac92)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:53.947302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:53.948965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 554/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:26:53 2022] GET /identity/v3/users/99fd297f6ef3454bb5b573330b76ac92 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:53.955504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:54.058505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8fd18-be1f-423a-a6e1-5856919d7cd8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:54.091903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:54.092545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:54.092827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:54.093100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:54.108674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:54.162018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:54.163384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:54.260869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 550/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:54.267172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:54.374357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127b5b-1704-4af5-8b8e-84b082a2e432 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:54.407176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:54.412529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d16e4-e34b-48f2-bffb-d457e30d3ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:54.413349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d16e4-e34b-48f2-bffb-d457e30d3ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:54.413635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d16e4-e34b-48f2-bffb-d457e30d3ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:54.413947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d16e4-e34b-48f2-bffb-d457e30d3ea1 None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:54.415242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d16e4-e34b-48f2-bffb-d457e30d3ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=041d83b221e446929f4b37b6013aa024)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:54.418121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d16e4-e34b-48f2-bffb-d457e30d3ea1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:54.418752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 555/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:26:54 2022] GET /identity/v3/projects/041d83b221e446929f4b37b6013aa024 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:54.426136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:54.475292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:54.530287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bdd49-c016-4514-aa87-06808f74f916 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:54.566791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947d298-041b-4d09-b686-0f41bc4d9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:54.567447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947d298-041b-4d09-b686-0f41bc4d9da0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:54.567733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947d298-041b-4d09-b686-0f41bc4d9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:54.568009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947d298-041b-4d09-b686-0f41bc4d9da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:54.568841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947d298-041b-4d09-b686-0f41bc4d9da0 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=041d83b221e446929f4b37b6013aa024, user.id=99fd297f6ef3454bb5b573330b76ac92) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:26:54.569158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947d298-041b-4d09-b686-0f41bc4d9da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:54.570631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947d298-041b-4d09-b686-0f41bc4d9da0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:54.576383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 551/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:26:54 2022] GET /identity/v3/role_assignments?user.id=99fd297f6ef3454bb5b573330b76ac92&scope.project.id=041d83b221e446929f4b37b6013aa024&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:56.644700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa7449-e30e-46e6-b3a5-e94db9504882 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:56.645226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa7449-e30e-46e6-b3a5-e94db9504882 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:56.645226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa7449-e30e-46e6-b3a5-e94db9504882 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:56.646786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 556/1107] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:56.652218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af56d-7230-4e59-9b6c-edee7af80f98 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:56.652650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af56d-7230-4e59-9b6c-edee7af80f98 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:56.652774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af56d-7230-4e59-9b6c-edee7af80f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:56.669127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-827af56d-7230-4e59-9b6c-edee7af80f98 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:56.670345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-827af56d-7230-4e59-9b6c-edee7af80f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:56.739841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 552/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:56.763827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa7449-e30e-46e6-b3a5-e94db9504882 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:56.867174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa7449-e30e-46e6-b3a5-e94db9504882 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:56.902724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22a7a-0926-4767-b066-97a395ddf74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:56.903517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22a7a-0926-4767-b066-97a395ddf74e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:56.903805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22a7a-0926-4767-b066-97a395ddf74e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:56.904084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22a7a-0926-4767-b066-97a395ddf74e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:56.905269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22a7a-0926-4767-b066-97a395ddf74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:56.907024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22a7a-0926-4767-b066-97a395ddf74e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:56.908663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 557/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:56.914783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827af56d-7230-4e59-9b6c-edee7af80f98 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:56.956553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:57.014054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827af56d-7230-4e59-9b6c-edee7af80f98 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:57.047739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d1733-76df-4f87-8bf1-014374b9ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:57.048401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d1733-76df-4f87-8bf1-014374b9ab1c None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:57.048680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d1733-76df-4f87-8bf1-014374b9ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:57.048952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d1733-76df-4f87-8bf1-014374b9ab1c None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:57.049647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d1733-76df-4f87-8bf1-014374b9ab1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:57.051106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d1733-76df-4f87-8bf1-014374b9ab1c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:57.148605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 553/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:26:56 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:26:59.219068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab647e36-4c10-4da3-85f0-66ef261e2277 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:59.219634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab647e36-4c10-4da3-85f0-66ef261e2277 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:59.219634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab647e36-4c10-4da3-85f0-66ef261e2277 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:59.220983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 558/1111] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:26:59.226585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97c77-0bd6-416a-b261-9a6257455311 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:59.226976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97c77-0bd6-416a-b261-9a6257455311 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:59.227157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97c77-0bd6-416a-b261-9a6257455311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:59.246342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-47e97c77-0bd6-416a-b261-9a6257455311 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:26:59.247554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-47e97c77-0bd6-416a-b261-9a6257455311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:26:59.316454 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 554/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:26:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:26:59.340218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab647e36-4c10-4da3-85f0-66ef261e2277 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:59.409611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:59.444186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab647e36-4c10-4da3-85f0-66ef261e2277 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:59.477873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:59.478641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:59.478919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:59.479190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] PATH_INFO: `/v3/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:59.480670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] RBAC: Authorizing `identity:get_role(role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:59.482069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:59.483435 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 559/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:26:59 2022] GET /identity/v3/roles/fb047c0afbd247f98f75175d913fed8e => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:59.490617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97c77-0bd6-416a-b261-9a6257455311 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:59.518402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:59.593796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97c77-0bd6-416a-b261-9a6257455311 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:59.628088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:59.628953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:59.629236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:59.629513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] PATH_INFO: `/v3/users/c1b231135d70490aaa695e59447ce3c5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:59.642840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] RBAC: Authorizing `identity:get_user(user_id=c1b231135d70490aaa695e59447ce3c5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:59.644297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:59.646034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 555/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:26:59 2022] GET /identity/v3/users/c1b231135d70490aaa695e59447ce3c5 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:26:59.652189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:26:59.753166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67cd22-da88-4afd-b777-a6c42a37130b None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:26:59.787421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:26:59.788071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:26:59.788358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:26:59.788637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:26:59.792137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:26:59.857120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:26:59.858861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:26:59.964194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 560/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:26:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:26:59.970927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:00.055145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:00.070071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30000f3c-e172-4461-94a4-8fa092213370 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:00.104741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7313536-107f-4304-a1ed-41c3894987d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:00.105596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7313536-107f-4304-a1ed-41c3894987d4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:00.105905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7313536-107f-4304-a1ed-41c3894987d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:00.106181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7313536-107f-4304-a1ed-41c3894987d4 None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:00.107374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7313536-107f-4304-a1ed-41c3894987d4 None admin] RBAC: Authorizing `identity:get_project(project_id=041d83b221e446929f4b37b6013aa024)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:00.109103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7313536-107f-4304-a1ed-41c3894987d4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:00.110982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 556/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:26:59 2022] GET /identity/v3/projects/041d83b221e446929f4b37b6013aa024 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:00.117594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:00.154150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:00.224136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b947-e43a-476e-97ac-c1c28451a0c2 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:00.260462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7a4a-0ada-4661-8906-44d29d9d35af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:00.261191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7a4a-0ada-4661-8906-44d29d9d35af None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:00.261476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7a4a-0ada-4661-8906-44d29d9d35af None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:00.261789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7a4a-0ada-4661-8906-44d29d9d35af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:00.262642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7a4a-0ada-4661-8906-44d29d9d35af None admin] RBAC: Adding query filter params (role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=041d83b221e446929f4b37b6013aa024, user.id=c1b231135d70490aaa695e59447ce3c5) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:00.262954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7a4a-0ada-4661-8906-44d29d9d35af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:00.264400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7a4a-0ada-4661-8906-44d29d9d35af None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:00.270674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 561/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:27:00 2022] GET /identity/v3/role_assignments?user.id=c1b231135d70490aaa695e59447ce3c5&scope.project.id=041d83b221e446929f4b37b6013aa024&role.id=fb047c0afbd247f98f75175d913fed8e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:02.273267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17227c-8e6e-4b59-894c-1bc870f513e2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:02.273861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17227c-8e6e-4b59-894c-1bc870f513e2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:02.273861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17227c-8e6e-4b59-894c-1bc870f513e2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:02.275227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 557/1118] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:02.281076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe89bc-ff7d-4e19-897f-8efdbafaf4d0 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:02.281520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe89bc-ff7d-4e19-897f-8efdbafaf4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:02.281996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe89bc-ff7d-4e19-897f-8efdbafaf4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:02.298439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-40fe89bc-ff7d-4e19-897f-8efdbafaf4d0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:02.299625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-40fe89bc-ff7d-4e19-897f-8efdbafaf4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:02.367295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 562/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:02.390655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17227c-8e6e-4b59-894c-1bc870f513e2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:02.498746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17227c-8e6e-4b59-894c-1bc870f513e2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:02.533885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:02.534742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:02.535024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:02.535294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] PATH_INFO: `/v3/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:02.536754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] RBAC: Authorizing `identity:get_role(role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:02.538297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:02.539662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 558/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:02 2022] GET /identity/v3/roles/fb047c0afbd247f98f75175d913fed8e => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:02.545582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe89bc-ff7d-4e19-897f-8efdbafaf4d0 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:02.578314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:02.649844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe89bc-ff7d-4e19-897f-8efdbafaf4d0 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:02.682546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:02.683406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:02.683696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:02.683972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] PATH_INFO: `/v3/users/c1b231135d70490aaa695e59447ce3c5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:02.685159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] RBAC: Authorizing `identity:get_user(user_id=c1b231135d70490aaa695e59447ce3c5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:02.687166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:02.688824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 563/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:02 2022] GET /identity/v3/users/c1b231135d70490aaa695e59447ce3c5 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:02.694633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:02.717055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:02.802358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620e2b0-e097-4a2a-8643-db13c8ba0173 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:02.839181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaaeba4-0a6d-42aa-93dc-5204b3a9fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:02.840060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaeba4-0a6d-42aa-93dc-5204b3a9fe00 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:02.840345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaeba4-0a6d-42aa-93dc-5204b3a9fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:02.840625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaeba4-0a6d-42aa-93dc-5204b3a9fe00 None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:02.841929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaaeba4-0a6d-42aa-93dc-5204b3a9fe00 None admin] RBAC: Authorizing `identity:get_project(project_id=041d83b221e446929f4b37b6013aa024)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:02.843670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaaeba4-0a6d-42aa-93dc-5204b3a9fe00 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:02.845455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 559/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:02 2022] GET /identity/v3/projects/041d83b221e446929f4b37b6013aa024 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:02.851643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:02.949437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:02.954355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1baf2-0ced-4c6a-b01b-f1b3ce7023df None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:02.989311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654552a-1a06-4126-b3c8-fa5dfe773afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:02.990224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654552a-1a06-4126-b3c8-fa5dfe773afc None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:02.990508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654552a-1a06-4126-b3c8-fa5dfe773afc None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:02.990786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654552a-1a06-4126-b3c8-fa5dfe773afc None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024/users/c1b231135d70490aaa695e59447ce3c5/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:02.993048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654552a-1a06-4126-b3c8-fa5dfe773afc None admin] RBAC: Authorizing `identity:create_grant(project_id=041d83b221e446929f4b37b6013aa024, user_id=c1b231135d70490aaa695e59447ce3c5, role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:02.994838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654552a-1a06-4126-b3c8-fa5dfe773afc None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:03.063989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 564/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:27:02 2022] PUT /identity/v3/projects/041d83b221e446929f4b37b6013aa024/users/c1b231135d70490aaa695e59447ce3c5/roles/fb047c0afbd247f98f75175d913fed8e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:27:05.082432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a3f1-391f-445f-8aef-4ad6243afeb4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:05.082971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a3f1-391f-445f-8aef-4ad6243afeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:05.082971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a3f1-391f-445f-8aef-4ad6243afeb4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:05.084323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 560/1124] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:27:05.089628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53f60-5901-42ff-8a01-ad93246ba449 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:05.090096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53f60-5901-42ff-8a01-ad93246ba449 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:05.090200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53f60-5901-42ff-8a01-ad93246ba449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:05.106813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a2a53f60-5901-42ff-8a01-ad93246ba449 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:05.108014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a2a53f60-5901-42ff-8a01-ad93246ba449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:05.175303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 565/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:05.198074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70a3f1-391f-445f-8aef-4ad6243afeb4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:05.290564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:05.304210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70a3f1-391f-445f-8aef-4ad6243afeb4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:05.342023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:05.343420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:05.343707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:05.343985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] PATH_INFO: `/v3/roles/fb047c0afbd247f98f75175d913fed8e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:05.345541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] RBAC: Authorizing `identity:get_role(role_id=fb047c0afbd247f98f75175d913fed8e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:05.346971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:05.348393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 561/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:05 2022] GET /identity/v3/roles/fb047c0afbd247f98f75175d913fed8e => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:05.354588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a53f60-5901-42ff-8a01-ad93246ba449 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:05.445131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:05.457452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a53f60-5901-42ff-8a01-ad93246ba449 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:05.494013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:05.495026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:05.495359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:05.495698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] PATH_INFO: `/v3/users/c1b231135d70490aaa695e59447ce3c5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:05.496990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] RBAC: Authorizing `identity:get_user(user_id=c1b231135d70490aaa695e59447ce3c5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:05.498514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:05.500182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 566/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:05 2022] GET /identity/v3/users/c1b231135d70490aaa695e59447ce3c5 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:05.506062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:05.605848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7fbf-a77a-4aee-a186-46f50c1539dc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:05.640270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:05.640926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:05.641205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:05.641476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:05.665771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:05.708089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:05.709541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:05.804979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 562/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:27:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:27:05.810922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:05.913437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d927d-7e7d-4d15-b829-a89b9d817e40 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:05.946834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaf90f-7396-4c77-8f44-c200833b651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:05.947683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaf90f-7396-4c77-8f44-c200833b651a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:05.947964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaf90f-7396-4c77-8f44-c200833b651a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:05.948235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaf90f-7396-4c77-8f44-c200833b651a None admin] PATH_INFO: `/v3/projects/041d83b221e446929f4b37b6013aa024` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:05.949400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaf90f-7396-4c77-8f44-c200833b651a None admin] RBAC: Authorizing `identity:get_project(project_id=041d83b221e446929f4b37b6013aa024)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:05.950877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaf90f-7396-4c77-8f44-c200833b651a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:05.953615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 567/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:05 2022] GET /identity/v3/projects/041d83b221e446929f4b37b6013aa024 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:05.960033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:06.013867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:06.055979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd7d61-871f-4a10-9bd9-70d9c39ad98e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:06.089528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dcef7-52cb-439a-9dea-ed9a630d81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:06.090195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dcef7-52cb-439a-9dea-ed9a630d81b3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:06.090487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dcef7-52cb-439a-9dea-ed9a630d81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:06.090765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dcef7-52cb-439a-9dea-ed9a630d81b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:06.091598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dcef7-52cb-439a-9dea-ed9a630d81b3 None admin] RBAC: Adding query filter params (role.id=fb047c0afbd247f98f75175d913fed8e, scope.project.id=041d83b221e446929f4b37b6013aa024, user.id=c1b231135d70490aaa695e59447ce3c5) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:06.091913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dcef7-52cb-439a-9dea-ed9a630d81b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:06.093759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dcef7-52cb-439a-9dea-ed9a630d81b3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:06.099594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 563/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:27:05 2022] GET /identity/v3/role_assignments?user.id=c1b231135d70490aaa695e59447ce3c5&scope.project.id=041d83b221e446929f4b37b6013aa024&role.id=fb047c0afbd247f98f75175d913fed8e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:08.097976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e818a4-f471-4b89-8aae-eef59bc42e59 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:08.098508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e818a4-f471-4b89-8aae-eef59bc42e59 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:08.098597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e818a4-f471-4b89-8aae-eef59bc42e59 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:08.099900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 568/1131] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:08.105039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f89479-c46d-4139-8eb6-6415f8360ef4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:08.105443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f89479-c46d-4139-8eb6-6415f8360ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:08.105584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f89479-c46d-4139-8eb6-6415f8360ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:08.122827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c1f89479-c46d-4139-8eb6-6415f8360ef4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:08.124176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c1f89479-c46d-4139-8eb6-6415f8360ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:08.190522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 564/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:08.213249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e818a4-f471-4b89-8aae-eef59bc42e59 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:08.240393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:08.318496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e818a4-f471-4b89-8aae-eef59bc42e59 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:08.352799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a659f30-20ec-4872-a9fa-bc0ef146ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:08.353506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a659f30-20ec-4872-a9fa-bc0ef146ecaa None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:08.353819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a659f30-20ec-4872-a9fa-bc0ef146ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:08.354097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a659f30-20ec-4872-a9fa-bc0ef146ecaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:08.355279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a659f30-20ec-4872-a9fa-bc0ef146ecaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:08.356724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a659f30-20ec-4872-a9fa-bc0ef146ecaa None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:08.358678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 569/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:27:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:08.364890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f89479-c46d-4139-8eb6-6415f8360ef4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:08.416458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:08.465870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f89479-c46d-4139-8eb6-6415f8360ef4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:08.499666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a511a-7cf0-4a92-87e5-010f7973b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:08.500326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a511a-7cf0-4a92-87e5-010f7973b2cb None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:08.500612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a511a-7cf0-4a92-87e5-010f7973b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:08.500890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a511a-7cf0-4a92-87e5-010f7973b2cb None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:08.501594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a511a-7cf0-4a92-87e5-010f7973b2cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:08.503053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a511a-7cf0-4a92-87e5-010f7973b2cb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:08.602478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 565/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:27:08 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:27:10.633385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c385521-adeb-4d7b-a79c-e7f42a16e734 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:10.633965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c385521-adeb-4d7b-a79c-e7f42a16e734 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:10.633965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c385521-adeb-4d7b-a79c-e7f42a16e734 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:10.635350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 570/1135] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:10.640952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c577a-ad65-4285-9492-eab76e441648 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:10.641391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c577a-ad65-4285-9492-eab76e441648 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:10.641498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c577a-ad65-4285-9492-eab76e441648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:10.659141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-779c577a-ad65-4285-9492-eab76e441648 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:10.660349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-779c577a-ad65-4285-9492-eab76e441648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:10.727688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 566/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:10.752298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c385521-adeb-4d7b-a79c-e7f42a16e734 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:10.846001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:10.855914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c385521-adeb-4d7b-a79c-e7f42a16e734 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:10.891830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806478-0f8e-46fd-b61d-401a001eaf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:10.892955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806478-0f8e-46fd-b61d-401a001eaf99 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:10.893273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806478-0f8e-46fd-b61d-401a001eaf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:10.893552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806478-0f8e-46fd-b61d-401a001eaf99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:10.894794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806478-0f8e-46fd-b61d-401a001eaf99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:10.896245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806478-0f8e-46fd-b61d-401a001eaf99 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:10.897907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 571/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:10.903827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c577a-ad65-4285-9492-eab76e441648 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:10.934257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:11.005460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c577a-ad65-4285-9492-eab76e441648 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:11.040094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2f57c-0094-45ca-833d-66fd4c082db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:11.040765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f57c-0094-45ca-833d-66fd4c082db6 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:11.041051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f57c-0094-45ca-833d-66fd4c082db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:11.041327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f57c-0094-45ca-833d-66fd4c082db6 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:11.042069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2f57c-0094-45ca-833d-66fd4c082db6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:11.043509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2f57c-0094-45ca-833d-66fd4c082db6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:11.148583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 567/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:27:10 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:27:13.236897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622313ec-a418-4666-9729-5e1357b0f973 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:13.237432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622313ec-a418-4666-9729-5e1357b0f973 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:13.237432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622313ec-a418-4666-9729-5e1357b0f973 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:13.238868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 572/1139] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:13.244145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71c53-0ac0-4042-9d44-97528704db6d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:13.244569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71c53-0ac0-4042-9d44-97528704db6d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:13.244694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71c53-0ac0-4042-9d44-97528704db6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:13.261546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bbb71c53-0ac0-4042-9d44-97528704db6d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:13.262756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bbb71c53-0ac0-4042-9d44-97528704db6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:13.332632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 568/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:13.355833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622313ec-a418-4666-9729-5e1357b0f973 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:13.455869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622313ec-a418-4666-9729-5e1357b0f973 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:13.490219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:13.490921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:13.491201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:13.491472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:13.501729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:27:13.509324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:27:13.510449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:27:13.511581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 573/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:27:13.517396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71c53-0ac0-4042-9d44-97528704db6d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:13.536592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:13.616842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71c53-0ac0-4042-9d44-97528704db6d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:13.650888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:13.651544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:13.651824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:13.652094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:13.652846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:13.653145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:13.654546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:13.663613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 569/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:13.669449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:13.691775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:13.769765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2b30-d962-495c-ab57-c9b684b1f12a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:13.804449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:13.805311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:13.805589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:13.805898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] PATH_INFO: `/v3/users/4c457434009446329142a0c98e46099a` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:13.819174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=4c457434009446329142a0c98e46099a)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:13.820615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:13.822350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 574/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:13 2022] GET /identity/v3/users/4c457434009446329142a0c98e46099a => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:13.828794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:13.911518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:13.931823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8192-a4fd-4522-8daa-d64e521d2e3d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:13.972627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:13.973269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:13.973547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:13.973852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:14.042239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:14.043591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:14.122787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:14.143017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 570/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:27:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:27:14.148921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:14.226744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:14.248294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7d85-efed-40d1-b55f-29069c17b0f1 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:14.284186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c2c1-0c00-4de0-807b-de68620c49b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:14.284982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c2c1-0c00-4de0-807b-de68620c49b5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:14.285266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c2c1-0c00-4de0-807b-de68620c49b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:14.285547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c2c1-0c00-4de0-807b-de68620c49b5 None admin] PATH_INFO: `/v3/projects/33010816a4164bc1b4b9b0f209c8b566` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:14.286800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c2c1-0c00-4de0-807b-de68620c49b5 None admin] RBAC: Authorizing `identity:get_project(project_id=33010816a4164bc1b4b9b0f209c8b566)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:14.288236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c2c1-0c00-4de0-807b-de68620c49b5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:14.289988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 575/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:14 2022] GET /identity/v3/projects/33010816a4164bc1b4b9b0f209c8b566 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:14.297226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:14.394425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632ddf-6bf0-4066-a069-7b01a6a07d61 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:14.430362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527790ab-97a0-4fd3-8fd8-a6162ba513df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:14.431012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527790ab-97a0-4fd3-8fd8-a6162ba513df None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:14.431291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527790ab-97a0-4fd3-8fd8-a6162ba513df None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:14.431562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527790ab-97a0-4fd3-8fd8-a6162ba513df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:14.432397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527790ab-97a0-4fd3-8fd8-a6162ba513df None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=33010816a4164bc1b4b9b0f209c8b566, user.id=4c457434009446329142a0c98e46099a) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:14.432703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527790ab-97a0-4fd3-8fd8-a6162ba513df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:14.434177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527790ab-97a0-4fd3-8fd8-a6162ba513df None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:14.440347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 571/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:27:14 2022] GET /identity/v3/role_assignments?user.id=4c457434009446329142a0c98e46099a&scope.project.id=33010816a4164bc1b4b9b0f209c8b566&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:16.434577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0c46-8f45-4cde-ad7c-e6ad37db69fc None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:16.435109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0c46-8f45-4cde-ad7c-e6ad37db69fc None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:16.435109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0c46-8f45-4cde-ad7c-e6ad37db69fc None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:16.437145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 576/1147] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:16.442398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ead0-814a-42b3-a8e2-bad9e9ac5bb7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:16.442820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ead0-814a-42b3-a8e2-bad9e9ac5bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:16.442942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ead0-814a-42b3-a8e2-bad9e9ac5bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:16.459763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1ed7ead0-814a-42b3-a8e2-bad9e9ac5bb7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:16.460945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1ed7ead0-814a-42b3-a8e2-bad9e9ac5bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:16.501317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:16.532698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 572/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 08:27:16.550731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee0c46-8f45-4cde-ad7c-e6ad37db69fc None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:16.649528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee0c46-8f45-4cde-ad7c-e6ad37db69fc None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:16.682855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:16.683628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:16.683910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:16.684182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:16.694407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:27:16.702517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:27:16.703637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:27:16.704494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 577/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:27:16.710198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ead0-814a-42b3-a8e2-bad9e9ac5bb7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:16.806540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ead0-814a-42b3-a8e2-bad9e9ac5bb7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:16.840468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:16.841172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:16.841460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:16.841769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:16.843395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:16.843705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:16.845109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:16.853705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 573/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:16.860390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:16.869771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:17.011586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9335-9ebe-433b-b804-b1f80bdbc321 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:17.054075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:17.054943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:17.055223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:17.055494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] PATH_INFO: `/v3/users/4c457434009446329142a0c98e46099a` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:17.056681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] RBAC: Authorizing `identity:get_user(user_id=4c457434009446329142a0c98e46099a)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:17.058154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:17.059778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 578/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:16 2022] GET /identity/v3/users/4c457434009446329142a0c98e46099a => generated 286 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:17.066364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:17.102596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:17.166672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee413e3-27d9-4411-835b-6d41a90d947d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:17.200050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8a825-0433-40bb-9804-fe07142b1fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:17.200894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8a825-0433-40bb-9804-fe07142b1fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:17.201172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8a825-0433-40bb-9804-fe07142b1fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:17.201480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8a825-0433-40bb-9804-fe07142b1fb6 None admin] PATH_INFO: `/v3/projects/33010816a4164bc1b4b9b0f209c8b566` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:17.202773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8a825-0433-40bb-9804-fe07142b1fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=33010816a4164bc1b4b9b0f209c8b566)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:17.204190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8a825-0433-40bb-9804-fe07142b1fb6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:17.205900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 574/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:17 2022] GET /identity/v3/projects/33010816a4164bc1b4b9b0f209c8b566 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:17.213189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:17.291286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:17.315427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a54a-2f69-42dc-8b1b-e6faffd2fa85 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:17.350344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50609933-d82e-413d-848e-52f9973e4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:17.351221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609933-d82e-413d-848e-52f9973e4a34 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:17.351499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609933-d82e-413d-848e-52f9973e4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:17.351770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609933-d82e-413d-848e-52f9973e4a34 None admin] PATH_INFO: `/v3/projects/33010816a4164bc1b4b9b0f209c8b566/users/4c457434009446329142a0c98e46099a/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:17.353737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609933-d82e-413d-848e-52f9973e4a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=33010816a4164bc1b4b9b0f209c8b566, user_id=4c457434009446329142a0c98e46099a, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:17.355168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609933-d82e-413d-848e-52f9973e4a34 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:17.455633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 579/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:27:17 2022] PUT /identity/v3/projects/33010816a4164bc1b4b9b0f209c8b566/users/4c457434009446329142a0c98e46099a/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:27:19.581653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c90e-f441-4afb-8787-afc2194d7f6c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:19.582261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c90e-f441-4afb-8787-afc2194d7f6c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:19.582261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c90e-f441-4afb-8787-afc2194d7f6c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:19.583609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 575/1154] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:19.589977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf39f-1908-4369-8762-5dea17c623ac None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:19.590414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf39f-1908-4369-8762-5dea17c623ac None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:19.590533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf39f-1908-4369-8762-5dea17c623ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:19.610401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-27fdf39f-1908-4369-8762-5dea17c623ac None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:19.611866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-27fdf39f-1908-4369-8762-5dea17c623ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:19.693604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 580/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:19.719973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c90e-f441-4afb-8787-afc2194d7f6c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:19.832464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c90e-f441-4afb-8787-afc2194d7f6c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:19.835042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:19.871056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:19.871851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:19.872159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:19.872819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:19.885452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:27:19.895830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:27:19.897036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:27:19.899691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 576/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:27:19.903662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdf39f-1908-4369-8762-5dea17c623ac None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:19.969196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:20.007103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdf39f-1908-4369-8762-5dea17c623ac None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:20.041938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:20.042726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:20.043016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:20.043298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:20.044082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:20.044392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:20.046290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:20.056700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 581/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:27:20.062989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:20.168936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2156a2-f8dd-4561-afcf-192726733003 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:20.204900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:20.205793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:20.206082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:20.206359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] PATH_INFO: `/v3/users/4c457434009446329142a0c98e46099a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:20.207564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] RBAC: Authorizing `identity:get_user(user_id=4c457434009446329142a0c98e46099a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:20.209094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:20.210858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 577/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:20 2022] GET /identity/v3/users/4c457434009446329142a0c98e46099a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:20.216700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:20.320630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6580f1-61a2-4cbe-903c-2a550485f7d5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:20.346590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:20.354956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:20.355598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:20.355879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:20.356153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:20.423730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:20.425094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:20.521287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 582/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:27:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:27:20.527200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:20.558971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:20.626880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c4dad-aa21-4b78-af6b-9e9b93031f62 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:20.660239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0d17c-acab-45d9-bcf9-67f0a46c5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:20.661097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d17c-acab-45d9-bcf9-67f0a46c5741 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:20.661383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d17c-acab-45d9-bcf9-67f0a46c5741 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:20.661663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d17c-acab-45d9-bcf9-67f0a46c5741 None admin] PATH_INFO: `/v3/projects/33010816a4164bc1b4b9b0f209c8b566` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:20.662864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0d17c-acab-45d9-bcf9-67f0a46c5741 None admin] RBAC: Authorizing `identity:get_project(project_id=33010816a4164bc1b4b9b0f209c8b566)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:20.664287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0d17c-acab-45d9-bcf9-67f0a46c5741 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:20.666026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 578/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:20 2022] GET /identity/v3/projects/33010816a4164bc1b4b9b0f209c8b566 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:20.672265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:20.698989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:20.771913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb4468-1f18-410f-8827-5c4b31693b95 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:20.805494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f411-a9d0-4054-99d5-b67806664fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:20.806170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f411-a9d0-4054-99d5-b67806664fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:20.806453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f411-a9d0-4054-99d5-b67806664fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:20.806729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f411-a9d0-4054-99d5-b67806664fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:20.807562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f411-a9d0-4054-99d5-b67806664fd3 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=33010816a4164bc1b4b9b0f209c8b566, user.id=4c457434009446329142a0c98e46099a) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:20.807872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f411-a9d0-4054-99d5-b67806664fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:20.809307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f411-a9d0-4054-99d5-b67806664fd3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:20.815755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 583/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:27:20 2022] GET /identity/v3/role_assignments?user.id=4c457434009446329142a0c98e46099a&scope.project.id=33010816a4164bc1b4b9b0f209c8b566&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:22.822029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c8da-ab92-420e-9a6e-0d4cf00e610e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:22.822560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c8da-ab92-420e-9a6e-0d4cf00e610e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:22.822652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c8da-ab92-420e-9a6e-0d4cf00e610e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:22.823956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 579/1162] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:22.829351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a496-f0bc-468d-928f-dd37b2af82f7 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:22.829832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a496-f0bc-468d-928f-dd37b2af82f7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:22.829941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a496-f0bc-468d-928f-dd37b2af82f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:22.847928 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-06e7a496-f0bc-468d-928f-dd37b2af82f7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:22.849137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-06e7a496-f0bc-468d-928f-dd37b2af82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:22.916875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 584/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:22.940240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069c8da-ab92-420e-9a6e-0d4cf00e610e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:23.041464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:23.046208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069c8da-ab92-420e-9a6e-0d4cf00e610e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:23.078990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:23.079557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:23.079844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:23.080119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:23.145785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:23.147238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:23.240015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:23.243665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 580/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:27:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:27:23.249697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a496-f0bc-468d-928f-dd37b2af82f7 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:23.270829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:23.347851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a496-f0bc-468d-928f-dd37b2af82f7 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:23.381952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81c467-e252-4f16-a623-cb202eb918f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:23.382751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81c467-e252-4f16-a623-cb202eb918f6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:23.383036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81c467-e252-4f16-a623-cb202eb918f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:23.383310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81c467-e252-4f16-a623-cb202eb918f6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:23.389921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81c467-e252-4f16-a623-cb202eb918f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:23.391404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81c467-e252-4f16-a623-cb202eb918f6 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-ec81c467-e252-4f16-a623-cb202eb918f6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:27:23.405668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:27:23.406944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:27:23.408171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 585/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:27:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:27:23.412860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:23.508327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece338-aae0-4e7b-89b6-14c2b207bfc2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:23.541129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d6d04-7e37-4461-b447-e0d2ca3879b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:23.541839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6d04-7e37-4461-b447-e0d2ca3879b3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:23.542126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6d04-7e37-4461-b447-e0d2ca3879b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:23.542400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6d04-7e37-4461-b447-e0d2ca3879b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:23.543127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6d04-7e37-4461-b447-e0d2ca3879b3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:23.543427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6d04-7e37-4461-b447-e0d2ca3879b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:23.545308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6d04-7e37-4461-b447-e0d2ca3879b3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:23.552944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 581/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 08:27:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:25.571128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70df56-5f0e-4005-a4c2-acd2960cb86e None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:25.571665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70df56-5f0e-4005-a4c2-acd2960cb86e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:25.571665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70df56-5f0e-4005-a4c2-acd2960cb86e None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:25.573063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 586/1167] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:25.579431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a92f56-1acc-405e-8bd9-d04aef05bd8b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:25.579871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a92f56-1acc-405e-8bd9-d04aef05bd8b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:25.579990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a92f56-1acc-405e-8bd9-d04aef05bd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:25.597951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-70a92f56-1acc-405e-8bd9-d04aef05bd8b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:25.599155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-70a92f56-1acc-405e-8bd9-d04aef05bd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:25.658817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:25.667694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 582/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:25.699100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70df56-5f0e-4005-a4c2-acd2960cb86e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:25.783396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:25.802716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70df56-5f0e-4005-a4c2-acd2960cb86e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:25.838927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fab59e-7410-4c8e-b5e7-6198ce3e1427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:25.839589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab59e-7410-4c8e-b5e7-6198ce3e1427 None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:25.839880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab59e-7410-4c8e-b5e7-6198ce3e1427 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:25.840173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab59e-7410-4c8e-b5e7-6198ce3e1427 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:25.840902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fab59e-7410-4c8e-b5e7-6198ce3e1427 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:25.843176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fab59e-7410-4c8e-b5e7-6198ce3e1427 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:25.918990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 587/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Mon Jul 18 08:27:25 2022] POST /identity/v3/domains => generated 267 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:27:27.964686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21a72-27e9-4ce8-840a-5aafd5b2b650 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:27.965225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21a72-27e9-4ce8-840a-5aafd5b2b650 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:27.965225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21a72-27e9-4ce8-840a-5aafd5b2b650 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:27.966646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 583/1170] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:27.972232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65571-a81e-4531-aa5d-16939c4d75ec None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:27.972648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65571-a81e-4531-aa5d-16939c4d75ec None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:27.972797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65571-a81e-4531-aa5d-16939c4d75ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:27.992385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7ac65571-a81e-4531-aa5d-16939c4d75ec None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:27.993694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7ac65571-a81e-4531-aa5d-16939c4d75ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:28.062195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 588/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:28.085736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a21a72-27e9-4ce8-840a-5aafd5b2b650 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:28.199743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a21a72-27e9-4ce8-840a-5aafd5b2b650 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:28.234661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc9405-ce13-47f6-b46a-552b8b630c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:28.235435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9405-ce13-47f6-b46a-552b8b630c4d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:28.235713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9405-ce13-47f6-b46a-552b8b630c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:28.235980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9405-ce13-47f6-b46a-552b8b630c4d None admin] PATH_INFO: `/v3/domains/c6243875a09043bcbb06ec52239e2eb1` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:28.246581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc9405-ce13-47f6-b46a-552b8b630c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=c6243875a09043bcbb06ec52239e2eb1)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:28.248615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc9405-ce13-47f6-b46a-552b8b630c4d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:28.250339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 584/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Jul 18 08:27:28 2022] GET /identity/v3/domains/c6243875a09043bcbb06ec52239e2eb1 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:28.256384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac65571-a81e-4531-aa5d-16939c4d75ec None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:28.325055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:28.355443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac65571-a81e-4531-aa5d-16939c4d75ec None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:28.393116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146de36a-c409-4986-a02c-815c0e7278ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:28.393838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de36a-c409-4986-a02c-815c0e7278ac None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:28.394126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de36a-c409-4986-a02c-815c0e7278ac None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:28.394404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de36a-c409-4986-a02c-815c0e7278ac None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:28.395135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146de36a-c409-4986-a02c-815c0e7278ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:28.396624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146de36a-c409-4986-a02c-815c0e7278ac None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:28.516008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 589/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:27:28 2022] POST /identity/v3/projects => generated 361 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:27:30.532150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062ef5-f9d5-459f-83dc-f8a520b72418 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:30.532647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062ef5-f9d5-459f-83dc-f8a520b72418 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:30.532743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062ef5-f9d5-459f-83dc-f8a520b72418 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:30.534099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 585/1174] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:30.539164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d35cc-9a77-4c3b-9656-9ff69a943122 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:30.539597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d35cc-9a77-4c3b-9656-9ff69a943122 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:30.539736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d35cc-9a77-4c3b-9656-9ff69a943122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:30.556517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a15d35cc-9a77-4c3b-9656-9ff69a943122 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:30.557761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a15d35cc-9a77-4c3b-9656-9ff69a943122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:30.626058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 590/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:30.651153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58062ef5-f9d5-459f-83dc-f8a520b72418 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:30.709528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:30.755464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58062ef5-f9d5-459f-83dc-f8a520b72418 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:30.789347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1f8e6-9c3b-41c4-96bf-2bbc37dae509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:30.790157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1f8e6-9c3b-41c4-96bf-2bbc37dae509 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:30.790445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1f8e6-9c3b-41c4-96bf-2bbc37dae509 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:30.790722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1f8e6-9c3b-41c4-96bf-2bbc37dae509 None admin] PATH_INFO: `/v3/domains/c6243875a09043bcbb06ec52239e2eb1` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:30.791912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1f8e6-9c3b-41c4-96bf-2bbc37dae509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c6243875a09043bcbb06ec52239e2eb1)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:30.793389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1f8e6-9c3b-41c4-96bf-2bbc37dae509 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:30.796161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 586/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Jul 18 08:27:30 2022] GET /identity/v3/domains/c6243875a09043bcbb06ec52239e2eb1 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:30.802221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d35cc-9a77-4c3b-9656-9ff69a943122 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:30.859244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:30.905447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d35cc-9a77-4c3b-9656-9ff69a943122 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:30.940654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160e5f5-23d5-41c0-82d2-c2148782047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:30.941325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160e5f5-23d5-41c0-82d2-c2148782047f None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:30.941611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160e5f5-23d5-41c0-82d2-c2148782047f None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:30.941918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160e5f5-23d5-41c0-82d2-c2148782047f None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:30.942623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160e5f5-23d5-41c0-82d2-c2148782047f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:30.944067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160e5f5-23d5-41c0-82d2-c2148782047f None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:31.051017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 591/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:27:30 2022] POST /identity/v3/users => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:27:33.141992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8c05-b94f-4740-94fb-6035e22f80b3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:33.142559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8c05-b94f-4740-94fb-6035e22f80b3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:33.142559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8c05-b94f-4740-94fb-6035e22f80b3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:33.143912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 587/1178] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:33.149051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a474-243d-4cd4-8a90-dc612caeb20d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:33.149441 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a474-243d-4cd4-8a90-dc612caeb20d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:33.149616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a474-243d-4cd4-8a90-dc612caeb20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:33.166306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d045a474-243d-4cd4-8a90-dc612caeb20d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:33.167485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d045a474-243d-4cd4-8a90-dc612caeb20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:33.234446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 592/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:33.258111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8c05-b94f-4740-94fb-6035e22f80b3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:33.359435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8c05-b94f-4740-94fb-6035e22f80b3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:33.382973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:33.395428 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:33.396155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:33.396440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:33.396715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:33.408187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:27:33.415933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:27:33.417017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:27:33.418015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 588/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:27:33.424161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a474-243d-4cd4-8a90-dc612caeb20d None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:33.462964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:33.523408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a474-243d-4cd4-8a90-dc612caeb20d None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:33.558973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:33.559664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:33.560019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:33.560295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:33.561184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:33.561493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:33.562908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:33.571458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 593/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:33.577321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:33.679033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2c7a0-2a52-4075-9abe-b7fadb36676d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:33.713220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:33.714120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:33.714405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:33.714683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] PATH_INFO: `/v3/users/eba3740fd71f45bba70f8c0cdf474276` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:33.728559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=eba3740fd71f45bba70f8c0cdf474276)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:33.730113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:33.732595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 589/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:33 2022] GET /identity/v3/users/eba3740fd71f45bba70f8c0cdf474276 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:33.738599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:33.838022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:33.841800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b83602-215f-4aa6-8bd4-abb92f27babc None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:33.876285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:33.876939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:33.877442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:33.877996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:33.948163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:33.949557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:34.047407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:34.051155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 594/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:27:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:27:34.057245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:34.100038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:34.156407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be29d5-5bec-4dae-b2c2-26e7f1cda5b1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:34.189585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289c8b6-4684-4ffc-b1d4-8c7088282f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:34.190462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289c8b6-4684-4ffc-b1d4-8c7088282f5c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:34.190747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289c8b6-4684-4ffc-b1d4-8c7088282f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:34.191024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289c8b6-4684-4ffc-b1d4-8c7088282f5c None admin] PATH_INFO: `/v3/projects/e75406deb33846d38e7c1ac61db01452` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:34.192204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289c8b6-4684-4ffc-b1d4-8c7088282f5c None admin] RBAC: Authorizing `identity:get_project(project_id=e75406deb33846d38e7c1ac61db01452)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:34.193631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289c8b6-4684-4ffc-b1d4-8c7088282f5c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:34.195358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 590/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:34 2022] GET /identity/v3/projects/e75406deb33846d38e7c1ac61db01452 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:34.202306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:34.302258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bb1f4-33eb-43dc-8fd7-c8d582c4cbb8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:34.337005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fe522-8f2c-45fa-95dc-f02256268d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:34.337661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fe522-8f2c-45fa-95dc-f02256268d6d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:34.337974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fe522-8f2c-45fa-95dc-f02256268d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:34.338252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fe522-8f2c-45fa-95dc-f02256268d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:34.339127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fe522-8f2c-45fa-95dc-f02256268d6d None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=e75406deb33846d38e7c1ac61db01452, user.id=eba3740fd71f45bba70f8c0cdf474276) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:34.339440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fe522-8f2c-45fa-95dc-f02256268d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:34.340998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fe522-8f2c-45fa-95dc-f02256268d6d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:34.346702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 595/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:27:34 2022] GET /identity/v3/role_assignments?user.id=eba3740fd71f45bba70f8c0cdf474276&scope.project.id=e75406deb33846d38e7c1ac61db01452&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:36.358180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964725-1710-4e70-87d2-ce9b9caa7108 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:36.358737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964725-1710-4e70-87d2-ce9b9caa7108 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:36.358737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964725-1710-4e70-87d2-ce9b9caa7108 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:36.360095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 591/1186] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:36.365322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae34f-b8bc-4b1b-bc14-f74221a338d1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:36.365788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae34f-b8bc-4b1b-bc14-f74221a338d1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:36.365913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae34f-b8bc-4b1b-bc14-f74221a338d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:36.383169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-332ae34f-b8bc-4b1b-bc14-f74221a338d1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:36.384395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-332ae34f-b8bc-4b1b-bc14-f74221a338d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:36.443339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:36.452536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 596/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:36.475194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29964725-1710-4e70-87d2-ce9b9caa7108 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:36.584351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29964725-1710-4e70-87d2-ce9b9caa7108 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:36.594420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:36.618612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:36.619317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:36.619605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:36.620086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:36.631475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:27:36.640117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:27:36.641239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:27:36.642398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 592/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:27:36.647499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae34f-b8bc-4b1b-bc14-f74221a338d1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:36.747049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae34f-b8bc-4b1b-bc14-f74221a338d1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:36.781881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:36.782548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:36.782833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:36.783108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:36.783856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:36.784161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:36.785549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:36.794215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 597/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:36.800097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:36.902042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccd3a7-6682-42e8-a1e0-d30a2ea4d9d9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:36.936354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:36.937251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:36.937534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:36.937857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] PATH_INFO: `/v3/users/eba3740fd71f45bba70f8c0cdf474276` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:36.939168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] RBAC: Authorizing `identity:get_user(user_id=eba3740fd71f45bba70f8c0cdf474276)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:36.940647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:36.942413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 593/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:36 2022] GET /identity/v3/users/eba3740fd71f45bba70f8c0cdf474276 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:36.948518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:37.008602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:37.053973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603def-4710-4fc5-8afc-a936841d238c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:37.087783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c9700-31c8-430c-9e32-9318edf78ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:37.088655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9700-31c8-430c-9e32-9318edf78ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:37.088942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9700-31c8-430c-9e32-9318edf78ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:37.089220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9700-31c8-430c-9e32-9318edf78ef6 None admin] PATH_INFO: `/v3/projects/e75406deb33846d38e7c1ac61db01452` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:37.090435 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c9700-31c8-430c-9e32-9318edf78ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=e75406deb33846d38e7c1ac61db01452)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:37.091927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c9700-31c8-430c-9e32-9318edf78ef6 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:37.093641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 598/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:36 2022] GET /identity/v3/projects/e75406deb33846d38e7c1ac61db01452 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:37.099793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:37.135937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:37.201263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158769f-8706-4681-935f-da703ace6e5e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:37.235141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34305f0-751c-42a2-86e8-064a1189f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:37.236019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34305f0-751c-42a2-86e8-064a1189f55f None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:37.236296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34305f0-751c-42a2-86e8-064a1189f55f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:37.236566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34305f0-751c-42a2-86e8-064a1189f55f None admin] PATH_INFO: `/v3/projects/e75406deb33846d38e7c1ac61db01452/users/eba3740fd71f45bba70f8c0cdf474276/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:37.238557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34305f0-751c-42a2-86e8-064a1189f55f None admin] RBAC: Authorizing `identity:create_grant(project_id=e75406deb33846d38e7c1ac61db01452, user_id=eba3740fd71f45bba70f8c0cdf474276, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:37.240689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34305f0-751c-42a2-86e8-064a1189f55f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:37.335752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 594/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:27:37 2022] PUT /identity/v3/projects/e75406deb33846d38e7c1ac61db01452/users/eba3740fd71f45bba70f8c0cdf474276/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:27:39.398267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b005f9-4ab9-4d27-a966-cac3821715be None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:39.398838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b005f9-4ab9-4d27-a966-cac3821715be None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:39.398838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b005f9-4ab9-4d27-a966-cac3821715be None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:39.400202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 599/1193] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:27:39.406255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e98ee-5564-4cd5-9cb0-7e5c9df9f91b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:39.406704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e98ee-5564-4cd5-9cb0-7e5c9df9f91b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:39.406817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e98ee-5564-4cd5-9cb0-7e5c9df9f91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:39.424444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-855e98ee-5564-4cd5-9cb0-7e5c9df9f91b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:27:39.425651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-855e98ee-5564-4cd5-9cb0-7e5c9df9f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:27:39.495085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 595/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:27:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:27:39.519293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b005f9-4ab9-4d27-a966-cac3821715be None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:39.623525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b005f9-4ab9-4d27-a966-cac3821715be None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:39.646621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:39.657603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:39.658397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:39.658681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:39.658957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:39.669697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:27:39.678063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:27:39.679216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:27:39.680273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 600/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:27:39.686055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e98ee-5564-4cd5-9cb0-7e5c9df9f91b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:39.712042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:39.784932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e98ee-5564-4cd5-9cb0-7e5c9df9f91b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:39.817877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:39.818548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:39.818834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:39.819113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:39.819859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:39.820168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:39.821530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:39.830516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 596/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:39.836564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:39.951428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd857b-c6db-4555-a8ca-8f397059ea0d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:39.987389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:39.988273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:39.988557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:39.988836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] PATH_INFO: `/v3/users/eba3740fd71f45bba70f8c0cdf474276` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:39.990076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] RBAC: Authorizing `identity:get_user(user_id=eba3740fd71f45bba70f8c0cdf474276)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:39.991512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:39.993152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 601/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 08:27:39 2022] GET /identity/v3/users/eba3740fd71f45bba70f8c0cdf474276 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:40.000324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:40.093087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:40.106001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330d57-a1b1-4dbc-a9ed-c151ca8041da None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:40.143458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:40.144116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:40.144403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:40.144679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:40.211609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:40.212980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:40.298828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:40.311966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 597/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:27:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:27:40.318054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:40.371453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:40.419968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a69ed5-826d-47ed-a54c-98b95ab1ac45 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:40.454073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d1cc5-aaf1-45b7-ab08-d2d1b71a250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:40.454923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1cc5-aaf1-45b7-ab08-d2d1b71a250e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:40.455204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1cc5-aaf1-45b7-ab08-d2d1b71a250e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:40.455478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1cc5-aaf1-45b7-ab08-d2d1b71a250e None admin] PATH_INFO: `/v3/projects/e75406deb33846d38e7c1ac61db01452` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:40.456647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d1cc5-aaf1-45b7-ab08-d2d1b71a250e None admin] RBAC: Authorizing `identity:get_project(project_id=e75406deb33846d38e7c1ac61db01452)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:40.458111 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d1cc5-aaf1-45b7-ab08-d2d1b71a250e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:40.459799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 602/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 08:27:40 2022] GET /identity/v3/projects/e75406deb33846d38e7c1ac61db01452 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:40.466051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:27:40.565391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29777a63-9377-4c1a-a1d9-50c98d37765e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:27:40.598102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75dff8-7a57-4540-afc8-213d2621294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:27:40.598751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dff8-7a57-4540-afc8-213d2621294e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:27:40.599046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dff8-7a57-4540-afc8-213d2621294e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:27:40.599322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dff8-7a57-4540-afc8-213d2621294e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:27:40.600151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dff8-7a57-4540-afc8-213d2621294e None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=e75406deb33846d38e7c1ac61db01452, user.id=eba3740fd71f45bba70f8c0cdf474276) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:27:40.600468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dff8-7a57-4540-afc8-213d2621294e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:27:40.601935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dff8-7a57-4540-afc8-213d2621294e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:27:40.608850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 598/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:27:40 2022] GET /identity/v3/role_assignments?user.id=eba3740fd71f45bba70f8c0cdf474276&scope.project.id=e75406deb33846d38e7c1ac61db01452&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:27:50.448974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=40 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:27:50.605085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=74 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:28:58.094458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86217e2-7451-4823-aa75-b653bed2e5a7 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:28:58.095070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86217e2-7451-4823-aa75-b653bed2e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:28:58.095070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86217e2-7451-4823-aa75-b653bed2e5a7 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:28:58.096417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 603/1201] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:28:58.101940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738fd03-73c0-4482-9eca-40d8ed68ccd9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:28:58.102425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738fd03-73c0-4482-9eca-40d8ed68ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:28:58.102561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738fd03-73c0-4482-9eca-40d8ed68ccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:28:58.120233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a738fd03-73c0-4482-9eca-40d8ed68ccd9 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:28:58.121438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a738fd03-73c0-4482-9eca-40d8ed68ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:28:58.189541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 599/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:28:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:28:58.214218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86217e2-7451-4823-aa75-b653bed2e5a7 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:28:58.324844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86217e2-7451-4823-aa75-b653bed2e5a7 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:28:58.361735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:28:58.362454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:28:58.362738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:28:58.363013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:28:58.373377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:28:58.374898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:28:58.392713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:28:58.393984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:28:58.394987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:28:58.394987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:28:58.394987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:28:58.394987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:28:58.394987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 604/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:28:58.400123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738fd03-73c0-4482-9eca-40d8ed68ccd9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:28:58.498607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738fd03-73c0-4482-9eca-40d8ed68ccd9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:28:58.526810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:28:58.533535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0cd37-15e9-40df-91d2-29f1697ebee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:28:58.534234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0cd37-15e9-40df-91d2-29f1697ebee0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:28:58.534516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0cd37-15e9-40df-91d2-29f1697ebee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:28:58.534790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0cd37-15e9-40df-91d2-29f1697ebee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:28:58.535505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0cd37-15e9-40df-91d2-29f1697ebee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:28:58.535808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0cd37-15e9-40df-91d2-29f1697ebee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:28:58.537167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0cd37-15e9-40df-91d2-29f1697ebee0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:28:58.548844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 600/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:28:58.554514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:28:58.611866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:28:58.659344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dbb6b-7f6d-451d-9ba1-182f69272ee7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:28:58.692255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae078d-ad10-42e0-ac64-2d43d0d58d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:28:58.692949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae078d-ad10-42e0-ac64-2d43d0d58d1b None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:28:58.693204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae078d-ad10-42e0-ac64-2d43d0d58d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:28:58.693473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae078d-ad10-42e0-ac64-2d43d0d58d1b None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:28:58.694202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae078d-ad10-42e0-ac64-2d43d0d58d1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:28:58.695714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae078d-ad10-42e0-ac64-2d43d0d58d1b None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:28:58.801607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 605/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 08:28:58 2022] POST /identity/v3/users => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:29:00.853886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043484c7-1b7a-44b3-a76c-4bcc5d17e2d0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:00.854449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043484c7-1b7a-44b3-a76c-4bcc5d17e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:00.854449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043484c7-1b7a-44b3-a76c-4bcc5d17e2d0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:00.855902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 601/1206] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:00.862484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8da3-e57d-40e2-bc4e-d50d52bbbc4e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:00.862924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8da3-e57d-40e2-bc4e-d50d52bbbc4e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:00.863021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8da3-e57d-40e2-bc4e-d50d52bbbc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:00.880664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-24de8da3-e57d-40e2-bc4e-d50d52bbbc4e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:00.881901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-24de8da3-e57d-40e2-bc4e-d50d52bbbc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:00.950601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 606/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:00.973797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043484c7-1b7a-44b3-a76c-4bcc5d17e2d0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:01.082899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043484c7-1b7a-44b3-a76c-4bcc5d17e2d0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:01.118190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:01.118987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:01.119273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:01.119565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:01.130591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:29:01.138353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:01.142641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:01.144278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 602/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:01.145936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8da3-e57d-40e2-bc4e-d50d52bbbc4e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:01.187716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:01.248087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8da3-e57d-40e2-bc4e-d50d52bbbc4e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:01.281317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:01.282027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:01.282311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:01.282595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:01.283346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:01.283717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:01.285096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:01.294173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 607/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:01.300696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:01.358294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:01.412133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7ea0e-a56c-4acb-90e9-c1039c100b95 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:01.448753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:01.449653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:01.450771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:01.451146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:01.461980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:01.463427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:01.482564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:01.484224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:01.485242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:01.485242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:01.485242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:01.485242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:01.485242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 603/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:01.489891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:01.594232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:01.597325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df106c-8f7d-4799-80e6-677efaee9166 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:01.637950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:01.638613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:01.638919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:01.639191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:01.639923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:01.640228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:01.641602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:01.654238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 608/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:01.660099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:01.765892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995e50-1f53-4e0a-b6ad-f27175b05822 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:01.767439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:01.799780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:01.800576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:01.800858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:01.801131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:01.808331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:01.810302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:29:01.825467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:01.826686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:01.828187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 604/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:01.835163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:01.938879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c173-56c2-4610-a080-af981c8da9a3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:01.972995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:01.973947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:01.974362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:01.974644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:01.975783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:01.976222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:01.978492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:01.998923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 609/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 08:29:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:02.004774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:02.105669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8168-21d6-4e7c-9994-2306bcc604b5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:02.140441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:02.141084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:02.141366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:02.141638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:02.171112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:02.207590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:02.209026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:02.313701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 605/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:29:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:29:02.319817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:02.339227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:02.424718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033c15-ab4d-48c7-887d-f586489d1348 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:02.461201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:02.462076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:02.462358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:02.462631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:02.473861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:02.475315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:02.493390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:02.497869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:02.499076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:02.499076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:02.499076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:02.499076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:02.499076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 610/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:02.501474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:02.564002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:02.602421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc361d-76cc-4a2e-bb6e-4261c0a9fcd5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:02.637058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:02.638298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:02.638570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:02.638836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:02.639549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:02.639847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:02.641263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:02.652842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 606/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:02.658948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:02.732049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:02.765859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1239a-4de5-4732-8ce3-ad2240ab0bf7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:02.802256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:02.803049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:02.803325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:02.803599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:02.811136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:02.812582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:29:02.826988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:02.831786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:02.833002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 611/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:02.834415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:02.939004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253717f-c826-46ba-be50-e7c22d0f8cb5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:02.961371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:02.973226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728ded-8288-4a94-ab6f-cbd8efd58041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:02.973915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ded-8288-4a94-ab6f-cbd8efd58041 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:02.974204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ded-8288-4a94-ab6f-cbd8efd58041 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:02.974482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ded-8288-4a94-ab6f-cbd8efd58041 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:02.975271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728ded-8288-4a94-ab6f-cbd8efd58041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:02.975615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728ded-8288-4a94-ab6f-cbd8efd58041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:02.977094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728ded-8288-4a94-ab6f-cbd8efd58041 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:02.990279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 607/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:02.996299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:03.100572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c167a9-9f41-4cc8-853b-c3c83354b4c5 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:03.129813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:03.135737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e8ca0-c9a1-4e83-83fd-69519860c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:03.136390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e8ca0-c9a1-4e83-83fd-69519860c609 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:03.136670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e8ca0-c9a1-4e83-83fd-69519860c609 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:03.136944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e8ca0-c9a1-4e83-83fd-69519860c609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:03.138416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e8ca0-c9a1-4e83-83fd-69519860c609 None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=bbbf155ccbb14c9b908a9077555feadf) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:03.138721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e8ca0-c9a1-4e83-83fd-69519860c609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:03.140160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e8ca0-c9a1-4e83-83fd-69519860c609 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:03.145711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 612/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:29:02 2022] GET /identity/v3/role_assignments?user.id=bbbf155ccbb14c9b908a9077555feadf&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:05.202589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9902-d1e3-495f-99cd-c3193525c22b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:05.203487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9902-d1e3-495f-99cd-c3193525c22b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:05.203487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9902-d1e3-495f-99cd-c3193525c22b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:05.204581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 608/1220] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:05.209987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b0ea-ef22-4114-9d29-b1e4a82b475b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:05.210429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b0ea-ef22-4114-9d29-b1e4a82b475b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:05.210545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b0ea-ef22-4114-9d29-b1e4a82b475b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:05.229293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-9d50b0ea-ef22-4114-9d29-b1e4a82b475b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:05.230654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9d50b0ea-ef22-4114-9d29-b1e4a82b475b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:05.302488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 613/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:05.326268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9902-d1e3-495f-99cd-c3193525c22b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:05.431941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9902-d1e3-495f-99cd-c3193525c22b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:05.469161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:05.469899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:05.470208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:05.470487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:05.482603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:29:05.490630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:05.491738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:05.492716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 609/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:29:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:05.500711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b0ea-ef22-4114-9d29-b1e4a82b475b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:05.610744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b0ea-ef22-4114-9d29-b1e4a82b475b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:05.635574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:05.647104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:05.647780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:05.648065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:05.648345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:05.649112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] RBAC: Adding query filter params (name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:05.649424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:05.651019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:05.660555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 614/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:29:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:05.666717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:05.717527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:05.779525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead93b4-4404-45d7-8567-cddae691ea76 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:05.821903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:05.822738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:05.828760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:05.828760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:05.835825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:05.837290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:05.856724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:05.857830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:05.858725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:05.858725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:05.858725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:05.858725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:05.858725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 610/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:05.863887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:05.968362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba769f43-ed09-4693-af95-c98fead8d77e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:06.003106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:06.003804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:06.004088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:06.004385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:06.005107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:06.005486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:06.006890 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:06.019554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 615/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:06.025636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:06.124325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:06.131132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be19ad-c6a9-45d8-803c-71ec0a034ec5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:06.165882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:06.166690 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:06.166973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:06.167267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:06.175114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:06.176614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:29:06.191019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:06.192148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:06.193236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 611/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:06.198306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:06.247960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:06.301338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd423e62-21d5-4b84-94cd-5ef30a96f3c8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:06.336905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:06.337626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:06.337949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:06.338225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:06.339114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:06.339587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:06.341816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:06.361339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 616/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 08:29:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:29:06.367333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:06.470527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24444e-ea3f-4446-9613-ecd1a99ce778 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:06.508036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:06.508923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:06.509304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:06.509653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:06.521300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:06.522898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:06.543047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:06.544887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:06.545825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:06.545825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:06.545825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:06.545825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:06.545825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 612/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:06.550950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:06.651174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54e6bf-a48b-48e0-9b77-c5c439e13b29 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:06.654079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:06.685205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:06.685907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:06.686195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:06.686474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:06.687206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:06.687516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:06.689028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:06.701497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 617/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:06.707634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:06.717854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:06.806675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9b91-60f3-4580-bd3d-ada92f644f1e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:06.843007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:06.843893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:06.844236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:06.844517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:06.851830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:06.853567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:29:06.870397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:06.872081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:06.873083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 613/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:06.878517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:06.980799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f9d6e-f810-45fd-9bc7-578f26c72e9a None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:07.015342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f06c7-75ec-4880-bcdd-82d8b3b3701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:07.016029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f06c7-75ec-4880-bcdd-82d8b3b3701c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:07.016314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f06c7-75ec-4880-bcdd-82d8b3b3701c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:07.016590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f06c7-75ec-4880-bcdd-82d8b3b3701c None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:07.017377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f06c7-75ec-4880-bcdd-82d8b3b3701c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:07.017704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f06c7-75ec-4880-bcdd-82d8b3b3701c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:07.019152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f06c7-75ec-4880-bcdd-82d8b3b3701c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:07.031833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 618/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:07.038025 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:07.104266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:07.141054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a5ab-1c26-45f3-a690-096df6678834 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:07.176963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35ab74-28dd-47ca-aa86-d2378383f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:07.177883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ab74-28dd-47ca-aa86-d2378383f2e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:07.178168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ab74-28dd-47ca-aa86-d2378383f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:07.178444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ab74-28dd-47ca-aa86-d2378383f2e4 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/bbbf155ccbb14c9b908a9077555feadf/roles/7dd1048f7a5241ea811f20171d0b4bd4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:07.193083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35ab74-28dd-47ca-aa86-d2378383f2e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=bbbf155ccbb14c9b908a9077555feadf, role_id=7dd1048f7a5241ea811f20171d0b4bd4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:07.194559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35ab74-28dd-47ca-aa86-d2378383f2e4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:07.281235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 614/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:29:07 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/bbbf155ccbb14c9b908a9077555feadf/roles/7dd1048f7a5241ea811f20171d0b4bd4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:29:09.312149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce411b0-e757-446c-8937-ab6ec7f69764 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:09.312742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce411b0-e757-446c-8937-ab6ec7f69764 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:09.312742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce411b0-e757-446c-8937-ab6ec7f69764 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:09.314185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 619/1233] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:09.319723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130a5b0-8ebc-4b63-88e7-3a5b76b5a2d7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:09.320178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130a5b0-8ebc-4b63-88e7-3a5b76b5a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:09.320271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130a5b0-8ebc-4b63-88e7-3a5b76b5a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:09.337216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c130a5b0-8ebc-4b63-88e7-3a5b76b5a2d7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:09.338452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c130a5b0-8ebc-4b63-88e7-3a5b76b5a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:09.407511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 615/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:09.430672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce411b0-e757-446c-8937-ab6ec7f69764 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:09.459101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:09.538954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce411b0-e757-446c-8937-ab6ec7f69764 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:09.573956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:09.575497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:09.575814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:09.576283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:09.590868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:29:09.599497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:09.604964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:09.606064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 620/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 08:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:09.607892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130a5b0-8ebc-4b63-88e7-3a5b76b5a2d7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:09.656257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:09.712489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130a5b0-8ebc-4b63-88e7-3a5b76b5a2d7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:09.748053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:09.748733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:09.749020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:09.749298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:09.750087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:09.750398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:09.751780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:09.760613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 616/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 08:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:09.766627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:09.856322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:09.873777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8831-a9f0-447b-86aa-40ba3408e7f6 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:09.908446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:09.909244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:09.909578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:09.909883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:09.920669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:09.922255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:09.940529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:09.941825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:09.947154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:09.947154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:09.947154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:09.947154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:09.947154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 621/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:09.948560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:10.056172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8e74-1777-4591-872c-b2fdc73f8aa8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:10.065739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:10.093350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:10.094089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:10.094416 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:10.094716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:10.095519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:10.095826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:10.097246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:10.112212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 617/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:29:10.118104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:10.232451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490652b-d959-4f5f-837a-65f0452f503d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:10.267115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:10.267932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:10.271733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:10.271733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:10.271733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:10.276807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:10.278839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:29:10.294799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:10.295937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:10.296888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 622/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:10.302016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:10.403036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a4d9c-196b-4ccd-9827-dfe6455940b2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:10.438930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:10.439601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:10.439880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:10.440150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:10.440986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:10.441299 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:10.442785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:10.460617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 618/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 08:29:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:10.467287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:10.571183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2ab67-0cbf-45aa-b4c0-04486f243cf8 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:10.608664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:10.609348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:10.609740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:10.610027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:10.671728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:10.678553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:10.680098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:10.778586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 623/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:29:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:29:10.784525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:10.812802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:10.889877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558294a3-842d-46ef-bd04-2f7582385687 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:10.924158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:10.924871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:10.925154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:10.925429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:10.936234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:10.937705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:10.955680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:10.956787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:10.958032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:10.958032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:10.958032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:10.958032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:10.958032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 619/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:10.962637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:11.055597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:11.061781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c9eab-ca97-4426-96bd-6b9c9ac14562 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:11.094825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:11.095480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:11.095763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:11.096038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:11.096754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:11.097056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:11.098457 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:11.109650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 624/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:11.115690 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:11.197550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:11.219188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427f7c-beda-4f3b-8c56-9bac2188c380 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:11.254975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:11.255770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:11.256051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:11.256322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:11.263184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:11.264626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:29:11.279365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:11.281671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:11.282748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 620/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:11.286776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:11.389509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a975b3-72c7-4cf0-a32d-aad550734cda None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:11.426157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a0c72-bc9c-4c7a-bf60-3e4103a16a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:11.426889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0c72-bc9c-4c7a-bf60-3e4103a16a78 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:11.427173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0c72-bc9c-4c7a-bf60-3e4103a16a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:11.427449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0c72-bc9c-4c7a-bf60-3e4103a16a78 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:11.428269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a0c72-bc9c-4c7a-bf60-3e4103a16a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:11.428577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a0c72-bc9c-4c7a-bf60-3e4103a16a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:11.430038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a0c72-bc9c-4c7a-bf60-3e4103a16a78 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:11.443112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 625/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:11.449504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:11.551947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f6916-b839-44e7-9417-4ae9c613aeef None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:11.585393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8f78-5993-46c6-861d-1b6e8c981cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:11.586136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8f78-5993-46c6-861d-1b6e8c981cdc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:11.586423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8f78-5993-46c6-861d-1b6e8c981cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:11.586699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8f78-5993-46c6-861d-1b6e8c981cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:11.587543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8f78-5993-46c6-861d-1b6e8c981cdc None admin] RBAC: Adding query filter params (role.id=7dd1048f7a5241ea811f20171d0b4bd4, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=bbbf155ccbb14c9b908a9077555feadf) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:11.587859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8f78-5993-46c6-861d-1b6e8c981cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:11.589410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8f78-5993-46c6-861d-1b6e8c981cdc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:11.596684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 621/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:29:11 2022] GET /identity/v3/role_assignments?user.id=bbbf155ccbb14c9b908a9077555feadf&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=7dd1048f7a5241ea811f20171d0b4bd4 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:13.666373 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d57a-678e-407c-aaf5-497ab18eb279 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:13.666929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d57a-678e-407c-aaf5-497ab18eb279 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:13.666929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d57a-678e-407c-aaf5-497ab18eb279 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:13.668349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 626/1247] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:13.674168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af75c-731a-49bc-a272-b301ac5d1ec3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:13.674760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af75c-731a-49bc-a272-b301ac5d1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:13.674760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af75c-731a-49bc-a272-b301ac5d1ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:13.679768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:13.692084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0f7af75c-731a-49bc-a272-b301ac5d1ec3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:13.693294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0f7af75c-731a-49bc-a272-b301ac5d1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:13.765991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 622/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:13.790227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6d57a-678e-407c-aaf5-497ab18eb279 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:13.809137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:13.897482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6d57a-678e-407c-aaf5-497ab18eb279 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:13.931846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:13.932643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:13.932930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:13.933206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:13.944185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:29:13.952584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:13.960432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:13.961492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 627/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:13.962435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7af75c-731a-49bc-a272-b301ac5d1ec3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:14.068339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7af75c-731a-49bc-a272-b301ac5d1ec3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:14.099420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:14.105056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:14.106376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:14.106660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:14.106938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:14.107693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:14.108002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:14.109379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:14.117832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 623/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:29:14.124146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:14.204474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:14.230302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9acd91-8442-40d6-9cf1-fbc85f6bcebd None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:14.267531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:14.268347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:14.268637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:14.268918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:14.281839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:14.283414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:14.303003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:14.304202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:14.320106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:14.320106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:14.320106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:14.320106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:14.320106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 628/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:29:14.320462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:14.419810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b631c-c957-45ad-839a-5591c61d4350 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:14.455083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:14.455756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:14.456043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:14.456324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:14.457047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:14.457357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:14.458768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:14.471552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 624/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:14.477699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:14.580317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd492b-b94e-4654-9448-8c5315ec6e84 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:14.608882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:14.616602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:14.617401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:14.617703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:14.617995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:14.625528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:14.627072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:29:14.641196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:14.642399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:14.648354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 629/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:14.649065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:14.706779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:14.750212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde2743-a8b3-439c-8697-d0b924b88615 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:14.787797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:14.788466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:14.788780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:14.789057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:14.789916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:14.790266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:14.791745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:14.810439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 625/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 08:29:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:14.816387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:14.922642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb548d6b-c262-498b-a957-655282c20047 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:14.956729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:14.957368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:14.957653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:14.957960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:15.013460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:15.025328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:15.026839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:15.125940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 630/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:29:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 08:29:15.131840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:15.231046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453c04-fc6d-4257-a387-234892055b1b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:15.244282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:15.265971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:15.266766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:15.267047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:15.267323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:15.277295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:15.278889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:15.296662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:15.297891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:15.303727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:15.303727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:15.303727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:15.303727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:15.303727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 626/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:15.304075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:15.395080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:15.407067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9997a72-6c66-4a86-af70-66b91dfcca9c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:15.441082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:15.441777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:15.442066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:15.442389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:15.443056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:15.443359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:15.444764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:15.456830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 631/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:15.462731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:15.567165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99487bad-26fb-40a7-8a66-02e50fcd3db8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:15.601822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:15.602871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:15.603155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:15.603432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:15.610249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:15.611684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:29:15.625932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:15.627096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:15.628408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 627/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:29:15.633127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:15.733537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8eca3-7097-40f9-a3fe-73a6d70795aa None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:15.768080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deddd8-04dc-4e32-b0e8-61075f1b9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:15.768744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deddd8-04dc-4e32-b0e8-61075f1b9b30 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:15.769033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deddd8-04dc-4e32-b0e8-61075f1b9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:15.769311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deddd8-04dc-4e32-b0e8-61075f1b9b30 None admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:15.770136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86deddd8-04dc-4e32-b0e8-61075f1b9b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:15.770450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86deddd8-04dc-4e32-b0e8-61075f1b9b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:15.771885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86deddd8-04dc-4e32-b0e8-61075f1b9b30 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:15.784989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 632/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:15.791320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:15.817622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:15.893598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77294856-26f4-4625-b09c-5dd1e7e06b41 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:15.928539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f35fa-d7d7-4c51-82a6-aa9d0378d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:15.930076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f35fa-d7d7-4c51-82a6-aa9d0378d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:15.930076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f35fa-d7d7-4c51-82a6-aa9d0378d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:15.930076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f35fa-d7d7-4c51-82a6-aa9d0378d4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:15.930566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f35fa-d7d7-4c51-82a6-aa9d0378d4d5 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=bbbf155ccbb14c9b908a9077555feadf) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:15.930872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f35fa-d7d7-4c51-82a6-aa9d0378d4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:15.932364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f35fa-d7d7-4c51-82a6-aa9d0378d4d5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:15.938355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 628/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:29:15 2022] GET /identity/v3/role_assignments?user.id=bbbf155ccbb14c9b908a9077555feadf&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:17.951645 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51640d-4918-47ef-939a-bc23d3ad0783 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:17.952227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51640d-4918-47ef-939a-bc23d3ad0783 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:17.952227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51640d-4918-47ef-939a-bc23d3ad0783 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:17.953585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 633/1261] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:17.960850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299551-7a7a-4523-8ddf-42369caad2a6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:17.961330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299551-7a7a-4523-8ddf-42369caad2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:17.961423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299551-7a7a-4523-8ddf-42369caad2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:17.978742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-14299551-7a7a-4523-8ddf-42369caad2a6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:17.980520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-14299551-7a7a-4523-8ddf-42369caad2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:18.052352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 629/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:18.076118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51640d-4918-47ef-939a-bc23d3ad0783 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:18.087557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:18.180677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51640d-4918-47ef-939a-bc23d3ad0783 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:18.220553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:18.221260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:18.221562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:18.221848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:18.233275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:29:18.240930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:18.241975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:18.242847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 634/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:18.248974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14299551-7a7a-4523-8ddf-42369caad2a6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:18.267492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:18.357980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14299551-7a7a-4523-8ddf-42369caad2a6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:18.392965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:18.393640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:18.393959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:18.394234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:18.394986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:18.395295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:18.396680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:18.405977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 630/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:29:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:18.413312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:18.497324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:18.543438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194b2bd-0c9a-4861-95de-91c98a128450 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:18.580672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:18.581484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:18.581835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:18.582191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:18.595593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:18.597111 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:18.618938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:18.619934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:18.621858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:18.621858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:18.621858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:18.621858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:18.621858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 635/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:18.626638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:18.727365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:18.747018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff9a86-34d1-4f12-99f0-0d748366a8a6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:18.781235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:18.781853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:18.782138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:18.782411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:18.783122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:18.783428 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:18.784832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:18.797577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 631/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:18.803806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:18.910189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01cfd2-547b-4bb8-9839-6b2542953cd9 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:18.931414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:18.946218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:18.947019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:18.947301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:18.947572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:18.955325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:18.956794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:29:18.971193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:18.972387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:18.973377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 636/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:18.978787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:19.080518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5e38-75ce-4933-9382-855f4d8c2ab4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:19.115966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:19.116636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:19.116922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:19.117201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:19.118177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:19.118426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:19.119860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:19.128693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:19.137117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 632/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 08:29:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:19.143083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:19.247645 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df3a37-1938-4706-ae0f-3dcbf463f45e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:19.281384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:19.282213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:19.282501 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:19.282778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:19.294158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:19.295698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:19.312815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:19.313996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:19.314925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:19.314925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:19.314925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:19.314925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:19.314925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 637/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:19.320225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:19.421181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e4dff-2ff5-4232-a205-444aea1c64d6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:19.456095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:19.456763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:19.457053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:19.457332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:19.458089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:19.458399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:19.459777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:19.471923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 633/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:19.478266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:19.510182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:19.581195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264cdb-504f-4fbe-9008-65a8149bf0ec None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:19.617513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:19.621709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:19.621709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:19.621709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:19.626367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:19.627824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:29:19.642301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:19.643421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:19.644546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 638/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:29:19.649784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:19.718091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:19.762556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a843-e6d8-43b5-8952-a7a18dcd8c83 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:19.795944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9146c4-508b-4ae6-8104-694684591914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:19.796737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9146c4-508b-4ae6-8104-694684591914 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:19.797022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9146c4-508b-4ae6-8104-694684591914 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:19.797294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9146c4-508b-4ae6-8104-694684591914 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:19.798200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9146c4-508b-4ae6-8104-694684591914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:19.798504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9146c4-508b-4ae6-8104-694684591914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:19.811048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9146c4-508b-4ae6-8104-694684591914 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:19.812538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 634/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:19.818516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:19.914747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:19.923117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3504d-227a-43e5-b731-cd1cae89c079 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:19.961710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc73ce-8614-4696-a9e1-57bdb3032984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:19.962606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc73ce-8614-4696-a9e1-57bdb3032984 None admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:19.962895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc73ce-8614-4696-a9e1-57bdb3032984 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:19.963199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc73ce-8614-4696-a9e1-57bdb3032984 None admin] PATH_INFO: `/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/bbbf155ccbb14c9b908a9077555feadf/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:19.965267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc73ce-8614-4696-a9e1-57bdb3032984 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4dd7d0ee5d4694b99bf22f5be513dd, user_id=bbbf155ccbb14c9b908a9077555feadf, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:19.966747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc73ce-8614-4696-a9e1-57bdb3032984 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:20.120340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 639/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 08:29:19 2022] PUT /identity/v3/projects/fe4dd7d0ee5d4694b99bf22f5be513dd/users/bbbf155ccbb14c9b908a9077555feadf/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:29:22.210772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadd7eb-a57e-4c38-b6dc-93be629ca374 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:22.211376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadd7eb-a57e-4c38-b6dc-93be629ca374 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:22.211376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadd7eb-a57e-4c38-b6dc-93be629ca374 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:22.212733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 635/1274] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:22.219157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9b41c-c5cd-473e-b932-2c25dd091495 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:22.219693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9b41c-c5cd-473e-b932-2c25dd091495 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:22.219693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9b41c-c5cd-473e-b932-2c25dd091495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:22.238957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-69e9b41c-c5cd-473e-b932-2c25dd091495 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:22.242459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-69e9b41c-c5cd-473e-b932-2c25dd091495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:22.314158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 640/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:22.340115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadd7eb-a57e-4c38-b6dc-93be629ca374 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:22.453746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadd7eb-a57e-4c38-b6dc-93be629ca374 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:22.474019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:22.493093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:22.493919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:22.494207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:22.494483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:22.504781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 08:29:22.513842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:22.518360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:22.519364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 636/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 08:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:29:22.522683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9b41c-c5cd-473e-b932-2c25dd091495 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:22.617420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:22.637517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9b41c-c5cd-473e-b932-2c25dd091495 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:22.676927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:22.677703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:22.677887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:22.678161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:22.678913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:22.679221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:22.680594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:22.691261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 641/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 08:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:22.697623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:22.801736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d64062-68ef-49de-aac3-2fd5cf63c8c8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:22.838830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:22.839724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:22.840008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:22.840280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:22.851616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:22.854301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:22.871002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:22.872782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:22.874113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:22.874113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:22.874113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:22.874113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:22.874113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 637/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:22.878335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:22.985606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004aff-b987-4d79-9998-92fb614ba79e None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:23.021377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:23.022088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:23.022369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:23.022643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:23.023750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:23.024282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:23.027274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:23.048032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 642/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:23.053944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:23.084563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:23.160598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944c278-08b2-4a64-90f1-477b8edb3c41 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:23.195059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:23.195864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:23.196152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:23.196426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:23.205144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:23.206616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 08:29:23.221723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:23.228946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:23.230005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 638/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:23.230840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:23.233348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:23.336226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b18f8-be7c-4d6c-ae8b-fc7d0b0d45d3 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:23.374352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:23.375000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:23.375287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:23.375566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:23.376416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:23.376727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:23.378277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:23.397487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 643/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 08:29:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:23.404487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:23.503709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:23.514060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160fe24-6a49-44b6-986b-b2868b49ee9a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:23.547987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:23.548647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:23.548932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:23.549207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:23.619778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:23.621837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:23.720633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:23.733755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 639/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 08:29:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 08:29:23.740508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:23.817177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:23.865614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400599-7cfe-4481-b2ea-86fa643d860c None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:23.908666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:23.909388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:23.909707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:23.909986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:23.924821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:23.926895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 08:29:23.948850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:23.951016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:23.952264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 08:29:23.952264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 08:29:23.952264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 08:29:23.952264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:23.952264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 644/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:23.954926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:24.071161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8654e-88ae-4d33-9906-2db3cc6034c8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:24.110111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:24.110785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:24.111066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:24.111342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:24.112139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:24.112423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:24.113937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:24.131561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 640/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 08:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:24.134166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:24.237851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a83dd-afd1-4e20-97d6-c2eedb106559 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:24.252318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:24.272184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:24.272978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:24.273267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:24.273548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:24.281116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:24.282655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 08:29:24.297780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:24.298885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: ERROR keystone.server.flask.application Jul 18 08:29:24.300173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 645/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 08:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:24.305046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:24.359747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:24.410064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f67d0-f7a3-4de2-873a-d84117e7fece None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:24.443988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5822e6-cc25-4516-97dc-801fb46f61c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:24.444649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5822e6-cc25-4516-97dc-801fb46f61c9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:24.444936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5822e6-cc25-4516-97dc-801fb46f61c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:24.445214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5822e6-cc25-4516-97dc-801fb46f61c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:24.446041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5822e6-cc25-4516-97dc-801fb46f61c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:24.446356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5822e6-cc25-4516-97dc-801fb46f61c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:24.447820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5822e6-cc25-4516-97dc-801fb46f61c9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:24.460728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 641/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 08:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:24.467482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:24.568627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27a69-6a00-4024-9c98-328f36eb6cd7 None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:24.604153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12dd8-9f72-4996-bcc5-503717bf1b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:24.605017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12dd8-9f72-4996-bcc5-503717bf1b46 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:24.605395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12dd8-9f72-4996-bcc5-503717bf1b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:24.605707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12dd8-9f72-4996-bcc5-503717bf1b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:24.606551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12dd8-9f72-4996-bcc5-503717bf1b46 None admin] RBAC: Adding query filter params (role.id=59754b7a88d744b39ff76e3b857aeebc, scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd, user.id=bbbf155ccbb14c9b908a9077555feadf) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:24.606868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12dd8-9f72-4996-bcc5-503717bf1b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:24.608412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12dd8-9f72-4996-bcc5-503717bf1b46 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:24.615053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 646/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 08:29:24 2022] GET /identity/v3/role_assignments?user.id=bbbf155ccbb14c9b908a9077555feadf&scope.project.id=fe4dd7d0ee5d4694b99bf22f5be513dd&role.id=59754b7a88d744b39ff76e3b857aeebc => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:26.673548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9017-7cad-4b5a-92d1-b2d0076a2601 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:26.674138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9017-7cad-4b5a-92d1-b2d0076a2601 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:26.674138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9017-7cad-4b5a-92d1-b2d0076a2601 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:26.675514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 642/1288] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:26.681079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a83ac-f48e-429e-ab05-b776815ccfc3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:26.681561 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a83ac-f48e-429e-ab05-b776815ccfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:26.681667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a83ac-f48e-429e-ab05-b776815ccfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:26.699413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a65a83ac-f48e-429e-ab05-b776815ccfc3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:26.700663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a65a83ac-f48e-429e-ab05-b776815ccfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:26.733289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:26.770798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 647/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:26.794291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9017-7cad-4b5a-92d1-b2d0076a2601 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:26.902632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9017-7cad-4b5a-92d1-b2d0076a2601 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:26.914035 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:26.937752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:26.938556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:26.938840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:26.939146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:26.939800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:26.941297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:26.953852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:26.955146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:26.956239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 643/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:29:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:26.961161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a83ac-f48e-429e-ab05-b776815ccfc3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:27.062057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a83ac-f48e-429e-ab05-b776815ccfc3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:27.096397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca527d8-e411-4f0b-882e-6b3d0c1f56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:27.097053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca527d8-e411-4f0b-882e-6b3d0c1f56da None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:27.097334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca527d8-e411-4f0b-882e-6b3d0c1f56da None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:27.097607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca527d8-e411-4f0b-882e-6b3d0c1f56da None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:27.098338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca527d8-e411-4f0b-882e-6b3d0c1f56da None admin] RBAC: Adding query filter params (name=placement) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:27.098639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca527d8-e411-4f0b-882e-6b3d0c1f56da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:27.100007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca527d8-e411-4f0b-882e-6b3d0c1f56da None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:27.105169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 648/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 08:29:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:27.111189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:27.212251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36417b5-6f7c-45a4-8988-ab2e2912660c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:27.247277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1e8f0-edc1-4940-8153-f545e070fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:27.247944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e8f0-edc1-4940-8153-f545e070fedb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:27.248229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e8f0-edc1-4940-8153-f545e070fedb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:27.248506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1e8f0-edc1-4940-8153-f545e070fedb None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:27.249213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1e8f0-edc1-4940-8153-f545e070fedb None admin] RBAC: Adding query filter params (type=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:27.249526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1e8f0-edc1-4940-8153-f545e070fedb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:27.250930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1e8f0-edc1-4940-8153-f545e070fedb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:27.255382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 644/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 08:29:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:29.302885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eced72c-426d-4450-a4cb-2d471a57f022 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:29.303466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eced72c-426d-4450-a4cb-2d471a57f022 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:29.303466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eced72c-426d-4450-a4cb-2d471a57f022 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:29.304839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 649/1293] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:29.311582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af2b52-b800-4528-a0ea-444f29179e3b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:29.312103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af2b52-b800-4528-a0ea-444f29179e3b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:29.312218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af2b52-b800-4528-a0ea-444f29179e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:29.330965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-64af2b52-b800-4528-a0ea-444f29179e3b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:29.332192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-64af2b52-b800-4528-a0ea-444f29179e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:29.366832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:29.409519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 645/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:29.433515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eced72c-426d-4450-a4cb-2d471a57f022 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:29.465613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:29.538115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eced72c-426d-4450-a4cb-2d471a57f022 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:29.573398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a12d5e-d4d4-4f26-8cee-b2fe7186620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:29.574070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12d5e-d4d4-4f26-8cee-b2fe7186620e None admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:29.574351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12d5e-d4d4-4f26-8cee-b2fe7186620e None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:29.574624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12d5e-d4d4-4f26-8cee-b2fe7186620e None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:29.575333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a12d5e-d4d4-4f26-8cee-b2fe7186620e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:29.576692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a12d5e-d4d4-4f26-8cee-b2fe7186620e None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:29.685126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 650/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 08:29:29 2022] POST /identity/v3/services => generated 246 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:29:31.704593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd572f9-1d29-4af8-b950-4105d3b52b6e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:31.705145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd572f9-1d29-4af8-b950-4105d3b52b6e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:31.705145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd572f9-1d29-4af8-b950-4105d3b52b6e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:31.706545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 646/1296] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:31.711854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a4e1-9870-4a42-b7af-04025187e747 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:31.712268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a4e1-9870-4a42-b7af-04025187e747 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:31.712448 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a4e1-9870-4a42-b7af-04025187e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:31.731009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6c85a4e1-9870-4a42-b7af-04025187e747 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:31.732229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6c85a4e1-9870-4a42-b7af-04025187e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:31.809931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 651/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:31.832873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd572f9-1d29-4af8-b950-4105d3b52b6e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:31.936579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd572f9-1d29-4af8-b950-4105d3b52b6e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:31.971531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:31.972360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:31.972644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:31.972919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:31.973568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:31.975072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:31.987430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:31.988621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:31.989716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 647/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:29:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 08:29:31.994743 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85a4e1-9870-4a42-b7af-04025187e747 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:32.014867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:32.097269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85a4e1-9870-4a42-b7af-04025187e747 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:32.132531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:32.133227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:32.133513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:32.133823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:32.134534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:32.134842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:32.136739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:32.142087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 652/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 08:29:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:32.148165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:32.180318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:32.248177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989ca6-64e4-49a8-9662-30e63e5cd3b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:32.281952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246ff92-2275-4ac9-a998-18f305776037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:32.282604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ff92-2275-4ac9-a998-18f305776037 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:32.282887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ff92-2275-4ac9-a998-18f305776037 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:32.283160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ff92-2275-4ac9-a998-18f305776037 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:32.284007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246ff92-2275-4ac9-a998-18f305776037 None admin] RBAC: Adding query filter params (interface=public, service_id=16aa8664767f469f8160dba5255a00da, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:32.284391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246ff92-2275-4ac9-a998-18f305776037 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:32.285785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246ff92-2275-4ac9-a998-18f305776037 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:32.290870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 648/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 08:29:32 2022] GET /identity/v3/endpoints?service_id=16aa8664767f469f8160dba5255a00da&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:32.296802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:32.376990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:32.395601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5acca-030c-4a91-9dd4-273c29f2608d None admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:32.429724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa61d3-a78e-422b-a0e5-fd56c4f20271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:32.430381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa61d3-a78e-422b-a0e5-fd56c4f20271 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:32.430669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa61d3-a78e-422b-a0e5-fd56c4f20271 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:32.430948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa61d3-a78e-422b-a0e5-fd56c4f20271 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:32.431656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa61d3-a78e-422b-a0e5-fd56c4f20271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:32.433310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa61d3-a78e-422b-a0e5-fd56c4f20271 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:32.440090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 653/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 08:29:32 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:29:34.459114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6b80a-6d87-4e8d-91a6-2f544e6c7ca0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:34.494477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6b80a-6d87-4e8d-91a6-2f544e6c7ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:34.494477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6b80a-6d87-4e8d-91a6-2f544e6c7ca0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:34.494477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 649/1302] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:29:34.494793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2593e9-94cf-47ce-b0c3-33dc396d5a09 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:34.494793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2593e9-94cf-47ce-b0c3-33dc396d5a09 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:34.494793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2593e9-94cf-47ce-b0c3-33dc396d5a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:34.494793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8c2593e9-94cf-47ce-b0c3-33dc396d5a09 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:29:34.494793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8c2593e9-94cf-47ce-b0c3-33dc396d5a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:29:34.551999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 654/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:29:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 08:29:34.575681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6b80a-6d87-4e8d-91a6-2f544e6c7ca0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:34.675538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:34.682125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6b80a-6d87-4e8d-91a6-2f544e6c7ca0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:34.716061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:34.716791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:34.717074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:34.717435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:34.718124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:34.719483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 08:29:34.731728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 08:29:34.732824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 18 08:29:34.733788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 650/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 08:29:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 08:29:34.739362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2593e9-94cf-47ce-b0c3-33dc396d5a09 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:34.816208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:34.839628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2593e9-94cf-47ce-b0c3-33dc396d5a09 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:34.873809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfb494-5514-4041-909c-2830b16c74a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:34.874471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb494-5514-4041-909c-2830b16c74a2 None admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:34.874755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb494-5514-4041-909c-2830b16c74a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:34.875030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb494-5514-4041-909c-2830b16c74a2 None admin] PATH_INFO: `/v3/services` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:34.875778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfb494-5514-4041-909c-2830b16c74a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:29:34.876085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfb494-5514-4041-909c-2830b16c74a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:34.877456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfb494-5514-4041-909c-2830b16c74a2 None admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:34.882655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 655/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 08:29:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:29:34.889124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:29:34.988058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc661e-9023-4de6-90c4-3fdd5534b5b2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:29:35.022468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b90c4-f2a5-4e80-a56e-ddd01d29389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:29:35.029291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b90c4-f2a5-4e80-a56e-ddd01d29389b None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:29:35.029291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b90c4-f2a5-4e80-a56e-ddd01d29389b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:29:35.029291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b90c4-f2a5-4e80-a56e-ddd01d29389b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:29:35.029291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b90c4-f2a5-4e80-a56e-ddd01d29389b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:29:35.029291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b90c4-f2a5-4e80-a56e-ddd01d29389b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:29:35.113418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 651/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 08:29:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:29:44.930381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=30 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:29:45.108804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:04.569256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44f61e-bb68-4c71-a829-08b257d8ec56 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:04.569865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44f61e-bb68-4c71-a829-08b257d8ec56 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:04.569865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44f61e-bb68-4c71-a829-08b257d8ec56 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:04.571701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 656/1307] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:04.576960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8717e6-f32f-4971-80a7-3c1a90c4e140 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:04.577471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8717e6-f32f-4971-80a7-3c1a90c4e140 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:04.577577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8717e6-f32f-4971-80a7-3c1a90c4e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:04.668920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cc8717e6-f32f-4971-80a7-3c1a90c4e140 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:04.670126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cc8717e6-f32f-4971-80a7-3c1a90c4e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:04.805907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 652/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:04.851145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd265-145c-4977-98fb-89e7514f2686 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:04.851442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd265-145c-4977-98fb-89e7514f2686 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:04.851727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd265-145c-4977-98fb-89e7514f2686 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:04.853301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 657/1309] 10.222.0.39 () {54 vars in 965 bytes} [Mon Jul 18 08:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:04.860000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1057f4-08da-413c-a045-12abfe9953d0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:04.860339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1057f4-08da-413c-a045-12abfe9953d0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:04.860694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1057f4-08da-413c-a045-12abfe9953d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:04.963413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8d1057f4-08da-413c-a045-12abfe9953d0 None None] MFA Rules not processed for user `b40cb94150444c81ab1de3c6c1c1ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:04.965563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8d1057f4-08da-413c-a045-12abfe9953d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:04.991796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:05.065790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 653/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Jul 18 08:37:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:05.075675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fd265-145c-4977-98fb-89e7514f2686 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:05.077599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-448fd265-145c-4977-98fb-89e7514f2686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:05.196496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fd265-145c-4977-98fb-89e7514f2686 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:05.279436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28739354-462b-4b6b-bac6-b56c8d14ba11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:05.280007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28739354-462b-4b6b-bac6-b56c8d14ba11 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:05.280289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28739354-462b-4b6b-bac6-b56c8d14ba11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:05.280564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28739354-462b-4b6b-bac6-b56c8d14ba11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:05.282330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-28739354-462b-4b6b-bac6-b56c8d14ba11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:05.343655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:05.411715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28739354-462b-4b6b-bac6-b56c8d14ba11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:05.413185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28739354-462b-4b6b-bac6-b56c8d14ba11 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:05.435355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 658/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:07.868709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4bae8-7b97-4427-be60-625e2e87085b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:07.869196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4bae8-7b97-4427-be60-625e2e87085b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:07.869342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4bae8-7b97-4427-be60-625e2e87085b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:07.871516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 654/1312] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:07.877582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f364ed-25b0-4542-ab23-785a05097323 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:07.878067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f364ed-25b0-4542-ab23-785a05097323 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:07.878273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f364ed-25b0-4542-ab23-785a05097323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:07.962390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-96f364ed-25b0-4542-ab23-785a05097323 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:07.963598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-96f364ed-25b0-4542-ab23-785a05097323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:08.075180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 659/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:08.115097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4bae8-7b97-4427-be60-625e2e87085b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:08.116856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-27b4bae8-7b97-4427-be60-625e2e87085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:08.237333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4bae8-7b97-4427-be60-625e2e87085b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:08.313777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:08.316595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ec1dd-c90f-4ef5-960f-7580a9fb3e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:08.317194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec1dd-c90f-4ef5-960f-7580a9fb3e98 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:08.317523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec1dd-c90f-4ef5-960f-7580a9fb3e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:08.317836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec1dd-c90f-4ef5-960f-7580a9fb3e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:08.319555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e79ec1dd-c90f-4ef5-960f-7580a9fb3e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:08.440978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ec1dd-c90f-4ef5-960f-7580a9fb3e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:08.442520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ec1dd-c90f-4ef5-960f-7580a9fb3e98 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:08.463443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 655/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:11.221136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a670e-0403-4fce-a6ad-6276dbeba3ea None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:11.221757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a670e-0403-4fce-a6ad-6276dbeba3ea None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:11.221757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a670e-0403-4fce-a6ad-6276dbeba3ea None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:11.223318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 660/1315] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:37:11.228932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b994cc-f604-4b4a-90ea-468b9bf8b105 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:11.229352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b994cc-f604-4b4a-90ea-468b9bf8b105 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:11.229485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b994cc-f604-4b4a-90ea-468b9bf8b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:11.295938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e0b994cc-f604-4b4a-90ea-468b9bf8b105 None None] MFA Rules not processed for user `194a4d4cc5174f9abf0af4c2de12d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:11.297149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e0b994cc-f604-4b4a-90ea-468b9bf8b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:11.351139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:11.397579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 656/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:11.455874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507d39-91c1-48d0-8fa5-794d0b803334 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:11.456167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507d39-91c1-48d0-8fa5-794d0b803334 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:11.456445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507d39-91c1-48d0-8fa5-794d0b803334 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:11.457875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 661/1317] 10.222.0.39 () {54 vars in 965 bytes} [Mon Jul 18 08:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:11.465159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97ffb7-138e-452f-b037-d40e97b1ad16 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:11.465444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97ffb7-138e-452f-b037-d40e97b1ad16 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:11.465739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97ffb7-138e-452f-b037-d40e97b1ad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:11.560118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0a97ffb7-138e-452f-b037-d40e97b1ad16 None None] MFA Rules not processed for user `b40cb94150444c81ab1de3c6c1c1ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:11.561358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0a97ffb7-138e-452f-b037-d40e97b1ad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:11.642258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 657/1318] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Jul 18 08:37:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:11.651315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78507d39-91c1-48d0-8fa5-794d0b803334 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:11.653230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-78507d39-91c1-48d0-8fa5-794d0b803334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:11.663022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:11.761626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78507d39-91c1-48d0-8fa5-794d0b803334 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:11.848045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0dce5-3f65-44e8-a3cf-0e3a986cc9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:11.848884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0dce5-3f65-44e8-a3cf-0e3a986cc9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:11.849140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0dce5-3f65-44e8-a3cf-0e3a986cc9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:11.849311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0dce5-3f65-44e8-a3cf-0e3a986cc9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:11.851105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-92f0dce5-3f65-44e8-a3cf-0e3a986cc9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:11.916205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:11.966543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0dce5-3f65-44e8-a3cf-0e3a986cc9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:11.968015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0dce5-3f65-44e8-a3cf-0e3a986cc9b4 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:11.987416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 662/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:15.329521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38273a2-896b-4a47-9f34-a7df1ca2f9b2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:15.330095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38273a2-896b-4a47-9f34-a7df1ca2f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:15.330225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38273a2-896b-4a47-9f34-a7df1ca2f9b2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:15.331608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 658/1320] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:15.336848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9dea2-c3d9-43aa-a2f4-82a7ff2fb798 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:15.337430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9dea2-c3d9-43aa-a2f4-82a7ff2fb798 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:15.337430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9dea2-c3d9-43aa-a2f4-82a7ff2fb798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:15.405206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-dbb9dea2-c3d9-43aa-a2f4-82a7ff2fb798 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:15.406485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dbb9dea2-c3d9-43aa-a2f4-82a7ff2fb798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:15.521054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 663/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:15.564754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38273a2-896b-4a47-9f34-a7df1ca2f9b2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:15.566348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f38273a2-896b-4a47-9f34-a7df1ca2f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:15.619893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:15.679662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38273a2-896b-4a47-9f34-a7df1ca2f9b2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:15.766400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f3257-47cc-4a19-9c24-07375bb548ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:15.767055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f3257-47cc-4a19-9c24-07375bb548ad service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:15.767335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f3257-47cc-4a19-9c24-07375bb548ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:15.767609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f3257-47cc-4a19-9c24-07375bb548ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:15.769304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-121f3257-47cc-4a19-9c24-07375bb548ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:15.882159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:15.894531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f3257-47cc-4a19-9c24-07375bb548ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:15.896007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f3257-47cc-4a19-9c24-07375bb548ad service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:15.915637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 659/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:19.137102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5c873-64e8-4e80-821d-36359519a5bd None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:19.137648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5c873-64e8-4e80-821d-36359519a5bd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:19.137872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5c873-64e8-4e80-821d-36359519a5bd None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:19.139280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 664/1323] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:19.145773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42032e-09bd-47ac-84c4-b7e9ea411003 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:19.146244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42032e-09bd-47ac-84c4-b7e9ea411003 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:19.146340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42032e-09bd-47ac-84c4-b7e9ea411003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:19.216320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8c42032e-09bd-47ac-84c4-b7e9ea411003 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:19.217532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c42032e-09bd-47ac-84c4-b7e9ea411003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:19.319462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 660/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:19.358671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5c873-64e8-4e80-821d-36359519a5bd None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:19.360226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-76c5c873-64e8-4e80-821d-36359519a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:19.382351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:19.479093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5c873-64e8-4e80-821d-36359519a5bd None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:19.565499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325bf7-d662-4260-82c5-ecee4fe9f8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:19.566222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325bf7-d662-4260-82c5-ecee4fe9f8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:19.566510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325bf7-d662-4260-82c5-ecee4fe9f8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:19.566787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325bf7-d662-4260-82c5-ecee4fe9f8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:19.568571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-57325bf7-d662-4260-82c5-ecee4fe9f8f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:19.644038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:19.684804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325bf7-d662-4260-82c5-ecee4fe9f8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:19.686311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325bf7-d662-4260-82c5-ecee4fe9f8f3 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:19.705786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 665/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:21.830345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2831851-0ea2-404c-8f1e-d1643c68afaa None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:21.831162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2831851-0ea2-404c-8f1e-d1643c68afaa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:21.831162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2831851-0ea2-404c-8f1e-d1643c68afaa None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:21.832475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 661/1326] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:21.838077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1955f1-979a-437e-aff0-452595372a6d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:21.839187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1955f1-979a-437e-aff0-452595372a6d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:21.839295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1955f1-979a-437e-aff0-452595372a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:21.909290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ea1955f1-979a-437e-aff0-452595372a6d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:21.910631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ea1955f1-979a-437e-aff0-452595372a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:22.014195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 666/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:22.051131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2831851-0ea2-404c-8f1e-d1643c68afaa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:22.052674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b2831851-0ea2-404c-8f1e-d1643c68afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:22.119620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:22.165155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2831851-0ea2-404c-8f1e-d1643c68afaa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:22.244336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8f180-1e80-482f-8528-42bd1b4397f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:22.245549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8f180-1e80-482f-8528-42bd1b4397f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:22.245866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8f180-1e80-482f-8528-42bd1b4397f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:22.246205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8f180-1e80-482f-8528-42bd1b4397f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:22.247893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-95b8f180-1e80-482f-8528-42bd1b4397f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:22.362929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:22.366118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8f180-1e80-482f-8528-42bd1b4397f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:22.367603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8f180-1e80-482f-8528-42bd1b4397f9 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:22.387052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 662/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:24.517601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4af3e-0de0-47aa-b9e3-9bdf351eac7e None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:24.518242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4af3e-0de0-47aa-b9e3-9bdf351eac7e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:24.518242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4af3e-0de0-47aa-b9e3-9bdf351eac7e None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:24.522209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 667/1329] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:24.526501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cc96-db3f-4db3-809f-33923682dbf0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:24.527147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cc96-db3f-4db3-809f-33923682dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:24.527147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578cc96-db3f-4db3-809f-33923682dbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:24.599907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e578cc96-db3f-4db3-809f-33923682dbf0 None None] MFA Rules not processed for user `194a4d4cc5174f9abf0af4c2de12d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:24.601178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e578cc96-db3f-4db3-809f-33923682dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:24.705357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 663/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:24.744677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4af3e-0de0-47aa-b9e3-9bdf351eac7e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:24.746415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-15e4af3e-0de0-47aa-b9e3-9bdf351eac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:24.780847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:24.862463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4af3e-0de0-47aa-b9e3-9bdf351eac7e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:24.941239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d652f94-7063-4050-9bca-ff8347fca4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:24.941933 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d652f94-7063-4050-9bca-ff8347fca4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:24.942216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d652f94-7063-4050-9bca-ff8347fca4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:24.942490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d652f94-7063-4050-9bca-ff8347fca4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:24.944216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9d652f94-7063-4050-9bca-ff8347fca4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:25.031388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:25.064062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d652f94-7063-4050-9bca-ff8347fca4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:25.065558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d652f94-7063-4050-9bca-ff8347fca4e0 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:25.086850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 668/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:27.694227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6777948-9fa5-4232-bc26-c8da7a79b664 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:27.694781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6777948-9fa5-4232-bc26-c8da7a79b664 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:27.694781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6777948-9fa5-4232-bc26-c8da7a79b664 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:27.696160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 664/1332] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:27.702980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181d4b7-94d7-456a-9fe9-6ba83ed019eb None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:27.703446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181d4b7-94d7-456a-9fe9-6ba83ed019eb None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:27.703570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181d4b7-94d7-456a-9fe9-6ba83ed019eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:27.770551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-5181d4b7-94d7-456a-9fe9-6ba83ed019eb None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:27.777447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5181d4b7-94d7-456a-9fe9-6ba83ed019eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:27.884349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 669/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:27.921046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6777948-9fa5-4232-bc26-c8da7a79b664 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:27.922656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d6777948-9fa5-4232-bc26-c8da7a79b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:28.005958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:28.050687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6777948-9fa5-4232-bc26-c8da7a79b664 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:28.133773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998e9bb-52b0-43f4-a125-e8fe372fe51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:28.134429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998e9bb-52b0-43f4-a125-e8fe372fe51c service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:28.134712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998e9bb-52b0-43f4-a125-e8fe372fe51c service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:28.134985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998e9bb-52b0-43f4-a125-e8fe372fe51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:28.137705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8998e9bb-52b0-43f4-a125-e8fe372fe51c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:28.252893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998e9bb-52b0-43f4-a125-e8fe372fe51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:28.254375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998e9bb-52b0-43f4-a125-e8fe372fe51c service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:28.266023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:28.276729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 665/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:30.418295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478bbf6-7f48-4b3b-bd00-658f643818bf None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:30.418914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478bbf6-7f48-4b3b-bd00-658f643818bf None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:30.418914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478bbf6-7f48-4b3b-bd00-658f643818bf None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:30.420321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 670/1335] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:30.426681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e79f9-ba8e-4697-91d7-8c84d4cc4426 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:30.427481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e79f9-ba8e-4697-91d7-8c84d4cc4426 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:30.427666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e79f9-ba8e-4697-91d7-8c84d4cc4426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:30.509838 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b63e79f9-ba8e-4697-91d7-8c84d4cc4426 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:30.511920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b63e79f9-ba8e-4697-91d7-8c84d4cc4426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:30.659610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 666/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:30.702361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478bbf6-7f48-4b3b-bd00-658f643818bf None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:30.703910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f478bbf6-7f48-4b3b-bd00-658f643818bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:30.753791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:30.828236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478bbf6-7f48-4b3b-bd00-658f643818bf None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:30.910472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f4915-fea9-4329-bf39-6b4fa9bed695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:30.911128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f4915-fea9-4329-bf39-6b4fa9bed695 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:30.911414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f4915-fea9-4329-bf39-6b4fa9bed695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:30.911689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f4915-fea9-4329-bf39-6b4fa9bed695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:30.913520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-494f4915-fea9-4329-bf39-6b4fa9bed695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:31.018243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:31.047930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f4915-fea9-4329-bf39-6b4fa9bed695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:31.049451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f4915-fea9-4329-bf39-6b4fa9bed695 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:31.071571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 671/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:33.921368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cc0f4-a9a9-4a56-a7d8-0472cce3ec77 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:33.921962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cc0f4-a9a9-4a56-a7d8-0472cce3ec77 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:33.921962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cc0f4-a9a9-4a56-a7d8-0472cce3ec77 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:33.923316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 667/1338] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:33.929213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9177a-fd01-4d87-9175-1a12b16fb94c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:33.932568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9177a-fd01-4d87-9175-1a12b16fb94c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:33.932568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9177a-fd01-4d87-9175-1a12b16fb94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:34.004121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-71a9177a-fd01-4d87-9175-1a12b16fb94c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:34.005390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-71a9177a-fd01-4d87-9175-1a12b16fb94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:34.117353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 672/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:34.155938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cc0f4-a9a9-4a56-a7d8-0472cce3ec77 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:34.157504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-270cc0f4-a9a9-4a56-a7d8-0472cce3ec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:34.244088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:34.275732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cc0f4-a9a9-4a56-a7d8-0472cce3ec77 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:34.358745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ec24b-cad5-4ed5-84b7-6d2f4cc3a40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:34.359415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ec24b-cad5-4ed5-84b7-6d2f4cc3a40f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:34.359702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ec24b-cad5-4ed5-84b7-6d2f4cc3a40f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:34.359976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ec24b-cad5-4ed5-84b7-6d2f4cc3a40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:34.361703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6f2ec24b-cad5-4ed5-84b7-6d2f4cc3a40f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:34.475973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ec24b-cad5-4ed5-84b7-6d2f4cc3a40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:34.477333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ec24b-cad5-4ed5-84b7-6d2f4cc3a40f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:34.498921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 668/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:39.155912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827e48-9b22-4ee2-abae-6dd446535e68 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:39.156433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827e48-9b22-4ee2-abae-6dd446535e68 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:39.156795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827e48-9b22-4ee2-abae-6dd446535e68 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:39.159613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 673/1341] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:39.165031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d0129-9bce-4ead-b52e-589460fdec8c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:39.166491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d0129-9bce-4ead-b52e-589460fdec8c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:39.166491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d0129-9bce-4ead-b52e-589460fdec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:39.170545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:39.263076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b26d0129-9bce-4ead-b52e-589460fdec8c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:39.264470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b26d0129-9bce-4ead-b52e-589460fdec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:39.385529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 669/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:39.418357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827e48-9b22-4ee2-abae-6dd446535e68 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:39.420327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-78827e48-9b22-4ee2-abae-6dd446535e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:39.474679 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:39.534855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827e48-9b22-4ee2-abae-6dd446535e68 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:39.615382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8622c6a-8900-46bd-8b41-e76b2ec88fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:39.615962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8622c6a-8900-46bd-8b41-e76b2ec88fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:39.616249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8622c6a-8900-46bd-8b41-e76b2ec88fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:39.616529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8622c6a-8900-46bd-8b41-e76b2ec88fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:39.618261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a8622c6a-8900-46bd-8b41-e76b2ec88fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:39.735823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:39.752177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8622c6a-8900-46bd-8b41-e76b2ec88fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:39.753625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8622c6a-8900-46bd-8b41-e76b2ec88fcd service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:39.773550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 674/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:42.974943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb063-aa2d-4ba0-b9fd-2cb5c6cc90a8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:42.975641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb063-aa2d-4ba0-b9fd-2cb5c6cc90a8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:42.975989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb063-aa2d-4ba0-b9fd-2cb5c6cc90a8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:42.977432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 670/1344] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:42.984110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10afff-6a57-4c57-b028-f1d894678f79 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:42.984815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10afff-6a57-4c57-b028-f1d894678f79 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:42.984815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10afff-6a57-4c57-b028-f1d894678f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:43.065821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3b10afff-6a57-4c57-b028-f1d894678f79 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:43.067196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3b10afff-6a57-4c57-b028-f1d894678f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:43.209761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 675/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:43.252232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb063-aa2d-4ba0-b9fd-2cb5c6cc90a8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:43.253915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-50ccb063-aa2d-4ba0-b9fd-2cb5c6cc90a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:43.356346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:43.376246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb063-aa2d-4ba0-b9fd-2cb5c6cc90a8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:43.477707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef93d4-3129-49fb-874f-ec9b0a308e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:43.478433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef93d4-3129-49fb-874f-ec9b0a308e80 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:43.478725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef93d4-3129-49fb-874f-ec9b0a308e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:43.478998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef93d4-3129-49fb-874f-ec9b0a308e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:43.480738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d0ef93d4-3129-49fb-874f-ec9b0a308e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:43.649560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef93d4-3129-49fb-874f-ec9b0a308e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:43.652534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef93d4-3129-49fb-874f-ec9b0a308e80 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:43.674508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 671/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:49.233841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaef00-a39a-4925-895e-2d56353e6696 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:49.234528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaef00-a39a-4925-895e-2d56353e6696 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:49.234528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaef00-a39a-4925-895e-2d56353e6696 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:49.235791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 676/1347] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:49.242673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b15ac-afbf-4c54-9258-d57ee49eacdb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:49.243200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b15ac-afbf-4c54-9258-d57ee49eacdb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:49.243644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b15ac-afbf-4c54-9258-d57ee49eacdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:49.267506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:49.337555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b29b15ac-afbf-4c54-9258-d57ee49eacdb None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:49.338823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b29b15ac-afbf-4c54-9258-d57ee49eacdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:49.453937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 672/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:49.491967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaef00-a39a-4925-895e-2d56353e6696 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:37:49.493577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6ccaef00-a39a-4925-895e-2d56353e6696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:49.573527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:49.632037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaef00-a39a-4925-895e-2d56353e6696 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:37:49.713075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917034ce-fe8e-4e37-9d16-fedcaec73757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:37:49.713966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917034ce-fe8e-4e37-9d16-fedcaec73757 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:49.714244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917034ce-fe8e-4e37-9d16-fedcaec73757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:49.714410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917034ce-fe8e-4e37-9d16-fedcaec73757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:49.716141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-917034ce-fe8e-4e37-9d16-fedcaec73757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:49.829464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:49.833936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917034ce-fe8e-4e37-9d16-fedcaec73757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:37:49.835527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917034ce-fe8e-4e37-9d16-fedcaec73757 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:37:49.855748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 677/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:37:54.953624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dffa2-2af3-4631-9b43-d68d42090c81 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:54.954453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dffa2-2af3-4631-9b43-d68d42090c81 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:54.954885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dffa2-2af3-4631-9b43-d68d42090c81 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:54.956964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 673/1350] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:37:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:37:54.963886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ed94b-79c2-4420-ad6e-98926a2a42d5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:37:54.963886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ed94b-79c2-4420-ad6e-98926a2a42d5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:37:54.964522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ed94b-79c2-4420-ad6e-98926a2a42d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:37:55.073486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bb9ed94b-79c2-4420-ad6e-98926a2a42d5 None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:37:55.075565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bb9ed94b-79c2-4420-ad6e-98926a2a42d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:37:55.225718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 678/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:37:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:37:59.449386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=59 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:00.228290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2d647-46f1-45bb-adac-58ace6edbfe0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:00.228791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2d647-46f1-45bb-adac-58ace6edbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:00.229277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2d647-46f1-45bb-adac-58ace6edbfe0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:00.231691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 674/1352] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:38:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:00.238314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69235b-7edb-4a34-8f60-824afc6c562f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:00.238865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69235b-7edb-4a34-8f60-824afc6c562f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:00.238865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69235b-7edb-4a34-8f60-824afc6c562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:00.314207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:00.344067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ad69235b-7edb-4a34-8f60-824afc6c562f None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:00.345318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ad69235b-7edb-4a34-8f60-824afc6c562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:00.486344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 679/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:02.177666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2305309-2762-4fb9-b751-5a6a5d10d1df None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:02.178198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2305309-2762-4fb9-b751-5a6a5d10d1df None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:02.178288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2305309-2762-4fb9-b751-5a6a5d10d1df None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:02.179965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 675/1354] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:02.186647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332996ac-b081-49e2-89b3-b81a8f930860 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:02.187209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332996ac-b081-49e2-89b3-b81a8f930860 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:02.187209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332996ac-b081-49e2-89b3-b81a8f930860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:02.319371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-332996ac-b081-49e2-89b3-b81a8f930860 None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:02.320902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-332996ac-b081-49e2-89b3-b81a8f930860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:02.390182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:02.502664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 680/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:38:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:38:06.037629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f72e6-2488-4baa-bdb5-90c06d1f8e5a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:06.038246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f72e6-2488-4baa-bdb5-90c06d1f8e5a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:06.038246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f72e6-2488-4baa-bdb5-90c06d1f8e5a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:06.040135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 676/1356] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:06.046676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e02d9a-fa4f-43f5-baca-2e71a38c1730 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:06.047226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e02d9a-fa4f-43f5-baca-2e71a38c1730 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:06.047226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e02d9a-fa4f-43f5-baca-2e71a38c1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:06.140145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f3e02d9a-fa4f-43f5-baca-2e71a38c1730 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:06.141360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f3e02d9a-fa4f-43f5-baca-2e71a38c1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:06.271232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 681/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:06.349913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e572cd3-b3f1-4f58-a1a6-8a9f05a4ba44 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:06.351202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e572cd3-b3f1-4f58-a1a6-8a9f05a4ba44 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:06.354877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e572cd3-b3f1-4f58-a1a6-8a9f05a4ba44 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:06.359996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 677/1358] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 08:38:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:06.374945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb2b6-8ba9-4aff-87de-0a3c464550cd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:06.377007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb2b6-8ba9-4aff-87de-0a3c464550cd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:06.377007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb2b6-8ba9-4aff-87de-0a3c464550cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:06.404797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:06.519377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c89cb2b6-8ba9-4aff-87de-0a3c464550cd None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:06.520586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c89cb2b6-8ba9-4aff-87de-0a3c464550cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:06.687926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 682/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:06.698641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e572cd3-b3f1-4f58-a1a6-8a9f05a4ba44 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:06.700266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8e572cd3-b3f1-4f58-a1a6-8a9f05a4ba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:06.863495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e572cd3-b3f1-4f58-a1a6-8a9f05a4ba44 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:06.947651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:06.992125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410db9f-fdf3-42ca-8d3e-85eeecfd66fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:06.993499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410db9f-fdf3-42ca-8d3e-85eeecfd66fe service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:06.993834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410db9f-fdf3-42ca-8d3e-85eeecfd66fe service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:06.994114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410db9f-fdf3-42ca-8d3e-85eeecfd66fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:06.995767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5410db9f-fdf3-42ca-8d3e-85eeecfd66fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:07.095621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410db9f-fdf3-42ca-8d3e-85eeecfd66fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:07.097248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410db9f-fdf3-42ca-8d3e-85eeecfd66fe service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:07.117477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 678/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:09.751096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07acb93-8d7d-406a-84c2-016f48e1ef79 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:09.751649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07acb93-8d7d-406a-84c2-016f48e1ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:09.751936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07acb93-8d7d-406a-84c2-016f48e1ef79 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:09.754279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 683/1361] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:09.762653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278929-8d18-4c71-929a-d49b58e023f5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:09.763115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278929-8d18-4c71-929a-d49b58e023f5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:09.763494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278929-8d18-4c71-929a-d49b58e023f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:09.869381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3c278929-8d18-4c71-929a-d49b58e023f5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:09.870822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3c278929-8d18-4c71-929a-d49b58e023f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:09.970056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:10.102888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 679/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:10.179524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07acb93-8d7d-406a-84c2-016f48e1ef79 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:10.182530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f07acb93-8d7d-406a-84c2-016f48e1ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:10.330568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:10.483961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07acb93-8d7d-406a-84c2-016f48e1ef79 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:10.658496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9a45f-066d-4de0-95b8-425367e2855f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:10.659502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9a45f-066d-4de0-95b8-425367e2855f service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:10.659770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9a45f-066d-4de0-95b8-425367e2855f service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:10.660165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9a45f-066d-4de0-95b8-425367e2855f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:10.662628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-19c9a45f-066d-4de0-95b8-425367e2855f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:10.700376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:10.819228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9a45f-066d-4de0-95b8-425367e2855f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:10.823131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9a45f-066d-4de0-95b8-425367e2855f service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:10.865756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 684/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:13.569372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2356a-438a-4cd6-a530-86ef2759476f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:13.570190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2356a-438a-4cd6-a530-86ef2759476f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:13.570190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2356a-438a-4cd6-a530-86ef2759476f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:13.572059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 680/1364] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:13.577394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf307-1e3e-4824-8960-aaedc0ab07b6 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:13.577914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf307-1e3e-4824-8960-aaedc0ab07b6 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:13.578021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf307-1e3e-4824-8960-aaedc0ab07b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:13.653615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-12aaf307-1e3e-4824-8960-aaedc0ab07b6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:13.654880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-12aaf307-1e3e-4824-8960-aaedc0ab07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:13.815341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:13.818806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 685/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:13.871411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37635-5958-4a90-b19e-f36b5c8828ff None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:13.871701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37635-5958-4a90-b19e-f36b5c8828ff None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:13.872173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37635-5958-4a90-b19e-f36b5c8828ff None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:13.873749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 681/1366] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 08:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:13.881007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1341-ff2c-4540-8d50-f9518a0b7397 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:13.881453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1341-ff2c-4540-8d50-f9518a0b7397 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:13.881875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1341-ff2c-4540-8d50-f9518a0b7397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:13.989219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-750a1341-ff2c-4540-8d50-f9518a0b7397 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:13.990497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-750a1341-ff2c-4540-8d50-f9518a0b7397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:14.140582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 686/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 08:38:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:14.149721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db37635-5958-4a90-b19e-f36b5c8828ff None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:14.151579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8db37635-5958-4a90-b19e-f36b5c8828ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:14.394417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db37635-5958-4a90-b19e-f36b5c8828ff None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:14.436266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:14.621406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f61b8-d852-4cfd-aac7-0232c4fc8452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:14.622308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f61b8-d852-4cfd-aac7-0232c4fc8452 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:14.622882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f61b8-d852-4cfd-aac7-0232c4fc8452 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:14.623424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f61b8-d852-4cfd-aac7-0232c4fc8452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:14.627064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-516f61b8-d852-4cfd-aac7-0232c4fc8452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:14.741378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f61b8-d852-4cfd-aac7-0232c4fc8452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:14.743804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f61b8-d852-4cfd-aac7-0232c4fc8452 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:14.764193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 682/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:38:15.710253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556fb5-56a2-4937-afa6-e5097276db43 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:15.711964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556fb5-56a2-4937-afa6-e5097276db43 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:15.711964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556fb5-56a2-4937-afa6-e5097276db43 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:15.712774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 687/1369] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:15.719447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640718-aeb9-4d52-83c3-e625f1483e1d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:15.720381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640718-aeb9-4d52-83c3-e625f1483e1d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:15.720664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640718-aeb9-4d52-83c3-e625f1483e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:15.755629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:15.812898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-06640718-aeb9-4d52-83c3-e625f1483e1d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:15.815072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-06640718-aeb9-4d52-83c3-e625f1483e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:15.946969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 683/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:16.274717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aecd8b-a19b-4995-a8d8-901de1eca830 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:16.274993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aecd8b-a19b-4995-a8d8-901de1eca830 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:16.275351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aecd8b-a19b-4995-a8d8-901de1eca830 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:16.276910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 688/1371] 10.222.0.39 () {54 vars in 964 bytes} [Mon Jul 18 08:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:16.285312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764398fd-7b66-43bf-a1bb-322c5317e07b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:16.285613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764398fd-7b66-43bf-a1bb-322c5317e07b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:16.285927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764398fd-7b66-43bf-a1bb-322c5317e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:16.402997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-764398fd-7b66-43bf-a1bb-322c5317e07b None None] MFA Rules not processed for user `b8d2f745ac2a4388a7890250141a4e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:16.404660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-764398fd-7b66-43bf-a1bb-322c5317e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:16.463302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:16.501781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 684/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Jul 18 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:16.517416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aecd8b-a19b-4995-a8d8-901de1eca830 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:16.519106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e3aecd8b-a19b-4995-a8d8-901de1eca830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:16.587254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:16.657070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aecd8b-a19b-4995-a8d8-901de1eca830 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:16.789882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621069-e7fe-4448-9663-47fe647c9e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:16.791316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621069-e7fe-4448-9663-47fe647c9e47 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:16.791773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621069-e7fe-4448-9663-47fe647c9e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:16.792716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621069-e7fe-4448-9663-47fe647c9e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:16.795392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-51621069-e7fe-4448-9663-47fe647c9e47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:16.944169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:16.960351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621069-e7fe-4448-9663-47fe647c9e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:16.963166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621069-e7fe-4448-9663-47fe647c9e47 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:16.989290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 689/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:17.126252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c4eff-74ae-47e4-87de-7f07ea0c3552 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:17.126866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c4eff-74ae-47e4-87de-7f07ea0c3552 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:17.126866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c4eff-74ae-47e4-87de-7f07ea0c3552 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:17.128157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 685/1374] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:17.134299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa9012-e3c2-49ee-82ca-acb5e43d6d8b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:17.134662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa9012-e3c2-49ee-82ca-acb5e43d6d8b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:17.135009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa9012-e3c2-49ee-82ca-acb5e43d6d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:17.205602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bdfa9012-e3c2-49ee-82ca-acb5e43d6d8b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:17.206979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bdfa9012-e3c2-49ee-82ca-acb5e43d6d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:17.312086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 690/1375] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:17.358453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c4eff-74ae-47e4-87de-7f07ea0c3552 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:17.360199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-152c4eff-74ae-47e4-87de-7f07ea0c3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:17.530595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c4eff-74ae-47e4-87de-7f07ea0c3552 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:17.599366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:17.671797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a97746-355e-457c-a53f-09bc18ebf1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:17.672718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a97746-355e-457c-a53f-09bc18ebf1bb service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:17.673013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a97746-355e-457c-a53f-09bc18ebf1bb service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:17.673291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a97746-355e-457c-a53f-09bc18ebf1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:17.675017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-17a97746-355e-457c-a53f-09bc18ebf1bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:17.784228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a97746-355e-457c-a53f-09bc18ebf1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:17.785891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a97746-355e-457c-a53f-09bc18ebf1bb service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:17.807513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 686/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:20.188534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a91ea1-de3b-47ed-8655-8322813bacae None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:20.189325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a91ea1-de3b-47ed-8655-8322813bacae None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:20.189325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a91ea1-de3b-47ed-8655-8322813bacae None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:20.191039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 691/1377] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:20.198114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4de2b-e953-4f67-80d7-48eb64884d06 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:20.198646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4de2b-e953-4f67-80d7-48eb64884d06 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:20.198939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4de2b-e953-4f67-80d7-48eb64884d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:20.270635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-09a4de2b-e953-4f67-80d7-48eb64884d06 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:20.271858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-09a4de2b-e953-4f67-80d7-48eb64884d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:20.279981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:20.389887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 687/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:20.444424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a91ea1-de3b-47ed-8655-8322813bacae None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:20.446785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a2a91ea1-de3b-47ed-8655-8322813bacae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:20.514460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:20.609760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a91ea1-de3b-47ed-8655-8322813bacae None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:20.733245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b7995-d451-4e6e-aacb-4f62e9dca263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:20.734010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b7995-d451-4e6e-aacb-4f62e9dca263 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:20.734298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b7995-d451-4e6e-aacb-4f62e9dca263 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:20.734578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b7995-d451-4e6e-aacb-4f62e9dca263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:20.736394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a26b7995-d451-4e6e-aacb-4f62e9dca263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:20.756450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:20.851310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b7995-d451-4e6e-aacb-4f62e9dca263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:20.853374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b7995-d451-4e6e-aacb-4f62e9dca263 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:20.874020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 692/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:23.212820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dead83-895f-4fc8-8f4c-5b12d4a6a8d3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:23.213458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dead83-895f-4fc8-8f4c-5b12d4a6a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:23.213458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dead83-895f-4fc8-8f4c-5b12d4a6a8d3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:23.214941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 688/1380] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:23.220611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440aba7-682a-417b-8341-6820e771aa0a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:23.221079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440aba7-682a-417b-8341-6820e771aa0a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:23.221159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440aba7-682a-417b-8341-6820e771aa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:23.297072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e440aba7-682a-417b-8341-6820e771aa0a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:23.298335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e440aba7-682a-417b-8341-6820e771aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:23.444642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:23.456258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 693/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:23.501505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dead83-895f-4fc8-8f4c-5b12d4a6a8d3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:23.503452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6dead83-895f-4fc8-8f4c-5b12d4a6a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:23.666954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:23.680513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dead83-895f-4fc8-8f4c-5b12d4a6a8d3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:23.823485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93db8b-734a-4385-b8ab-e420fd600d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:23.824244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93db8b-734a-4385-b8ab-e420fd600d03 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:23.824600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93db8b-734a-4385-b8ab-e420fd600d03 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:23.824987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93db8b-734a-4385-b8ab-e420fd600d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:23.826762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1e93db8b-734a-4385-b8ab-e420fd600d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:23.952959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93db8b-734a-4385-b8ab-e420fd600d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:23.956032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93db8b-734a-4385-b8ab-e420fd600d03 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:23.978416 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:23.994693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 689/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:26.333887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8016-6e55-4fc5-af87-d979cb8278d0 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:26.334777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8016-6e55-4fc5-af87-d979cb8278d0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:26.335504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8016-6e55-4fc5-af87-d979cb8278d0 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:26.338421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 694/1383] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:26.348513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4482-612b-4883-b110-b19e14053ae4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:26.349111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4482-612b-4883-b110-b19e14053ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:26.349215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4482-612b-4883-b110-b19e14053ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:26.455418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-537a4482-612b-4883-b110-b19e14053ae4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:26.457266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-537a4482-612b-4883-b110-b19e14053ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:26.600964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 690/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:26.669536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da8016-6e55-4fc5-af87-d979cb8278d0 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:26.672828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-41da8016-6e55-4fc5-af87-d979cb8278d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:26.917990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da8016-6e55-4fc5-af87-d979cb8278d0 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:27.025998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:27.091126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e265c-ed9f-4d27-be2b-ebf4393662a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:27.091856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e265c-ed9f-4d27-be2b-ebf4393662a3 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:27.092073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e265c-ed9f-4d27-be2b-ebf4393662a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:27.092393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e265c-ed9f-4d27-be2b-ebf4393662a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:27.094710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d19e265c-ed9f-4d27-be2b-ebf4393662a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:27.223028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e265c-ed9f-4d27-be2b-ebf4393662a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:27.225185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e265c-ed9f-4d27-be2b-ebf4393662a3 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:27.253982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 695/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:29.588141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143c8a-23e0-4ada-a3be-f78494512096 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:29.588826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143c8a-23e0-4ada-a3be-f78494512096 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:29.589487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143c8a-23e0-4ada-a3be-f78494512096 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:29.593891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 691/1386] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:29.600721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5806abb-98f7-4650-87dd-acce05801f91 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:29.601880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5806abb-98f7-4650-87dd-acce05801f91 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:29.602128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5806abb-98f7-4650-87dd-acce05801f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:29.701064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f5806abb-98f7-4650-87dd-acce05801f91 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:29.703166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f5806abb-98f7-4650-87dd-acce05801f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:29.787471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:29.878211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 696/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:29.935958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143c8a-23e0-4ada-a3be-f78494512096 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:29.938162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-99143c8a-23e0-4ada-a3be-f78494512096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:30.053174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:30.173323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143c8a-23e0-4ada-a3be-f78494512096 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:30.328830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63048c-2f05-470e-997f-93e45055ebfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:30.329994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63048c-2f05-470e-997f-93e45055ebfc service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:30.330501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63048c-2f05-470e-997f-93e45055ebfc service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:30.331049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63048c-2f05-470e-997f-93e45055ebfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:30.333507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1a63048c-2f05-470e-997f-93e45055ebfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:30.412359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:30.499688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63048c-2f05-470e-997f-93e45055ebfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:30.501347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63048c-2f05-470e-997f-93e45055ebfc service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:30.530745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 692/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:38:32.996132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02565a6-755b-461c-ba73-9aa72f3942ae None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:32.998108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02565a6-755b-461c-ba73-9aa72f3942ae None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:32.998108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02565a6-755b-461c-ba73-9aa72f3942ae None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:32.998824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 697/1389] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:33.007998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ab55-0ef8-40b9-92d5-08a3574694fa None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:33.008823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ab55-0ef8-40b9-92d5-08a3574694fa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:33.008823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ab55-0ef8-40b9-92d5-08a3574694fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:33.102605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9a72ab55-0ef8-40b9-92d5-08a3574694fa None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:33.103823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9a72ab55-0ef8-40b9-92d5-08a3574694fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:33.249450 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 693/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:33.313333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02565a6-755b-461c-ba73-9aa72f3942ae None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:33.315289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c02565a6-755b-461c-ba73-9aa72f3942ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:33.399167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265b0ac-1b2c-4a95-ac26-57de403b9067 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:33.399465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265b0ac-1b2c-4a95-ac26-57de403b9067 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:33.399752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265b0ac-1b2c-4a95-ac26-57de403b9067 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:33.401191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 694/1391] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:33.407217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d62e-14b1-48f5-8d0a-a4c70eee2f85 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:33.407507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d62e-14b1-48f5-8d0a-a4c70eee2f85 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:33.407785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d62e-14b1-48f5-8d0a-a4c70eee2f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:33.423696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:33.502896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8035d62e-14b1-48f5-8d0a-a4c70eee2f85 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:33.504080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8035d62e-14b1-48f5-8d0a-a4c70eee2f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:33.552300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02565a6-755b-461c-ba73-9aa72f3942ae None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:33.573545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:33.630716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 695/1392] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:38:33.696294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb15a0-f5df-4ed8-855c-220eddfa62e9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:33.697005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb15a0-f5df-4ed8-855c-220eddfa62e9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:33.697005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb15a0-f5df-4ed8-855c-220eddfa62e9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:33.698706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 696/1393] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 08:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:38:33.702969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:33.703625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:33.703914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:33.704194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:33.705944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:33.706597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640dc9e-64dc-4ae0-a39b-495900c2c900 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:33.707033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640dc9e-64dc-4ae0-a39b-495900c2c900 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:33.707447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640dc9e-64dc-4ae0-a39b-495900c2c900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:33.811544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f640dc9e-64dc-4ae0-a39b-495900c2c900 None None] MFA Rules not processed for user `ec22f82d0e7745f282c5837459fba05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:33.812774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f640dc9e-64dc-4ae0-a39b-495900c2c900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:33.840336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:33.848869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:33.863619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 698/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:33.868206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:33.928358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 697/1395] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:38:33.936580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:33.937849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:33.962166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:34.020508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a43b-239f-4247-91b1-fa60daefe872 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:34.102901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab18ca4-88c7-4505-8e67-09d46ac8ef2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:34.103467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18ca4-88c7-4505-8e67-09d46ac8ef2d service glance] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:34.103718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18ca4-88c7-4505-8e67-09d46ac8ef2d service glance] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:34.103994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18ca4-88c7-4505-8e67-09d46ac8ef2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:34.105669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eab18ca4-88c7-4505-8e67-09d46ac8ef2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:34.216262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:34.234247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab18ca4-88c7-4505-8e67-09d46ac8ef2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:34.237299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab18ca4-88c7-4505-8e67-09d46ac8ef2d service glance] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:34.266372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 699/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:35.194848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f00123-3cd1-4fc3-bc6c-0d5688091d47 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:35.197328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f00123-3cd1-4fc3-bc6c-0d5688091d47 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:35.197328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f00123-3cd1-4fc3-bc6c-0d5688091d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:35.269749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-32f00123-3cd1-4fc3-bc6c-0d5688091d47 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:35.270886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-32f00123-3cd1-4fc3-bc6c-0d5688091d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:35.395331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 698/1397] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:38:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:35.452270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22e030-c80c-4ec2-9c3b-779383aa465c None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:35.452826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22e030-c80c-4ec2-9c3b-779383aa465c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:35.452826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22e030-c80c-4ec2-9c3b-779383aa465c None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:35.454273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 700/1398] 10.222.0.39 () {54 vars in 943 bytes} [Mon Jul 18 08:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:35.462174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e636b2-60a0-402a-9ce4-3e7f555bc34d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:35.462539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e636b2-60a0-402a-9ce4-3e7f555bc34d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:35.462853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e636b2-60a0-402a-9ce4-3e7f555bc34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:35.528358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:35.548366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-22e636b2-60a0-402a-9ce4-3e7f555bc34d None None] MFA Rules not processed for user `083f9aa9e5d84adbb8a82f1b0addd788`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:35.549568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-22e636b2-60a0-402a-9ce4-3e7f555bc34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:35.706580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 699/1399] 10.222.0.39 () {58 vars in 1040 bytes} [Mon Jul 18 08:38:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:35.718967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22e030-c80c-4ec2-9c3b-779383aa465c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:35.722088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4e22e030-c80c-4ec2-9c3b-779383aa465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:35.905896 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22e030-c80c-4ec2-9c3b-779383aa465c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:35.985913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:36.031589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f1b2-88cd-49d0-a5ed-e63f284ec114 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:36.032245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f1b2-88cd-49d0-a5ed-e63f284ec114 service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:36.032531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f1b2-88cd-49d0-a5ed-e63f284ec114 service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:36.032813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f1b2-88cd-49d0-a5ed-e63f284ec114 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:36.034551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4a48f1b2-88cd-49d0-a5ed-e63f284ec114 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:36.144046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f1b2-88cd-49d0-a5ed-e63f284ec114 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:36.145767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f1b2-88cd-49d0-a5ed-e63f284ec114 service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:36.155164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 701/1400] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:38:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:38:36.369863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207dc3f-ba8d-453b-b0f1-4983e40ff9f4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:36.370617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207dc3f-ba8d-453b-b0f1-4983e40ff9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:36.370617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207dc3f-ba8d-453b-b0f1-4983e40ff9f4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:36.371941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 700/1401] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:36.378534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf4f9-896b-4a40-a06e-8cf39eb61deb None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:36.382979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf4f9-896b-4a40-a06e-8cf39eb61deb None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:36.382979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf4f9-896b-4a40-a06e-8cf39eb61deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:36.449021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-631bf4f9-896b-4a40-a06e-8cf39eb61deb None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:36.450226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-631bf4f9-896b-4a40-a06e-8cf39eb61deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:36.507953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:36.569332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 702/1402] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:38:36.624456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207dc3f-ba8d-453b-b0f1-4983e40ff9f4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:36.626476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3207dc3f-ba8d-453b-b0f1-4983e40ff9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:36.799319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:36.868135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207dc3f-ba8d-453b-b0f1-4983e40ff9f4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:37.064692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f60653-9c1c-40ae-9a2d-2c4fe01a8207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:37.065795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60653-9c1c-40ae-9a2d-2c4fe01a8207 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:37.066327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60653-9c1c-40ae-9a2d-2c4fe01a8207 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:37.066846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60653-9c1c-40ae-9a2d-2c4fe01a8207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:37.070818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b3f60653-9c1c-40ae-9a2d-2c4fe01a8207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:37.205500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:37.228882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f60653-9c1c-40ae-9a2d-2c4fe01a8207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:37.230637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f60653-9c1c-40ae-9a2d-2c4fe01a8207 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:37.261328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 701/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:38:39.733622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7646-e856-4dac-a3ac-ec3426f09958 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:39.734247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7646-e856-4dac-a3ac-ec3426f09958 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:39.734247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7646-e856-4dac-a3ac-ec3426f09958 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:39.735604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 703/1404] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:39.747434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc6eb5-cbea-4aff-af60-f7720c8cb82f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:39.748650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc6eb5-cbea-4aff-af60-f7720c8cb82f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:39.750410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc6eb5-cbea-4aff-af60-f7720c8cb82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:39.839876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-99dc6eb5-cbea-4aff-af60-f7720c8cb82f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:39.841098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-99dc6eb5-cbea-4aff-af60-f7720c8cb82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:39.962209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 702/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:40.013232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d7646-e856-4dac-a3ac-ec3426f09958 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:40.014948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ae8d7646-e856-4dac-a3ac-ec3426f09958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:40.230963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d7646-e856-4dac-a3ac-ec3426f09958 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:40.279923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:40.391129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a738b-f976-40cd-90f9-9f3962e7ad57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:40.391788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a738b-f976-40cd-90f9-9f3962e7ad57 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:40.392084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a738b-f976-40cd-90f9-9f3962e7ad57 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:40.392376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a738b-f976-40cd-90f9-9f3962e7ad57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:40.394305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-da2a738b-f976-40cd-90f9-9f3962e7ad57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:40.513672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a738b-f976-40cd-90f9-9f3962e7ad57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:40.515702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a738b-f976-40cd-90f9-9f3962e7ad57 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:40.540914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 704/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:42.872186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b48be5-d67c-4d7e-b812-8292a01aef89 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:42.872778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b48be5-d67c-4d7e-b812-8292a01aef89 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:42.872778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b48be5-d67c-4d7e-b812-8292a01aef89 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:42.874267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 703/1407] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:38:42.879673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea7feb-1d4a-4ce1-8d4a-e0a4741572ea None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:42.880172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea7feb-1d4a-4ce1-8d4a-e0a4741572ea None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:42.880278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea7feb-1d4a-4ce1-8d4a-e0a4741572ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:42.948008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:42.974872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-65ea7feb-1d4a-4ce1-8d4a-e0a4741572ea None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:38:42.977747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-65ea7feb-1d4a-4ce1-8d4a-e0a4741572ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:43.112027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 705/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:38:43.158725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b48be5-d67c-4d7e-b812-8292a01aef89 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:38:43.160274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-23b48be5-d67c-4d7e-b812-8292a01aef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:43.226839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:43.339317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b48be5-d67c-4d7e-b812-8292a01aef89 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:38:43.470651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015e32a-3949-4b5d-8de0-14b380a57d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:38:43.471221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015e32a-3949-4b5d-8de0-14b380a57d00 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:38:43.471506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015e32a-3949-4b5d-8de0-14b380a57d00 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:38:43.471784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015e32a-3949-4b5d-8de0-14b380a57d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:38:43.473476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4015e32a-3949-4b5d-8de0-14b380a57d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:38:43.484779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:43.585820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015e32a-3949-4b5d-8de0-14b380a57d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:38:43.587847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015e32a-3949-4b5d-8de0-14b380a57d00 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:38:43.623821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 704/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:53.110340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=46 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:53.609138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=41 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:00.125087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7babafd-0153-44ff-a95e-a720c3b4c874 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:00.125658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7babafd-0153-44ff-a95e-a720c3b4c874 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:00.125658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7babafd-0153-44ff-a95e-a720c3b4c874 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:00.127053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 706/1410] 10.222.0.39 () {54 vars in 918 bytes} [Mon Jul 18 08:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:00.132896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6530-253b-456c-a472-4ba32b2b5e7a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:00.133437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6530-253b-456c-a472-4ba32b2b5e7a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:00.133437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6530-253b-456c-a472-4ba32b2b5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:00.211866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-01ca6530-253b-456c-a472-4ba32b2b5e7a None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:00.213004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-01ca6530-253b-456c-a472-4ba32b2b5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:00.321455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 705/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jul 18 08:39:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:00.336183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124198d1-75a7-42a5-9c85-3f224e46b506 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:00.336477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124198d1-75a7-42a5-9c85-3f224e46b506 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:00.336759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124198d1-75a7-42a5-9c85-3f224e46b506 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:00.338218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 707/1412] 10.222.0.39 () {54 vars in 918 bytes} [Mon Jul 18 08:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:39:00.343392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013bb03-cf75-4251-b03f-fd3f4a9cd3f9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:00.343684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013bb03-cf75-4251-b03f-fd3f4a9cd3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:00.343960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013bb03-cf75-4251-b03f-fd3f4a9cd3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:00.417607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:00.420955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3013bb03-cf75-4251-b03f-fd3f4a9cd3f9 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:00.422218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3013bb03-cf75-4251-b03f-fd3f4a9cd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:00.544600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 706/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jul 18 08:39:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:03.069526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9e575-b7f5-4c59-b5f9-a8733624ed58 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:03.070128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9e575-b7f5-4c59-b5f9-a8733624ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:03.070128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9e575-b7f5-4c59-b5f9-a8733624ed58 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:03.071463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:03.076986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac97f-c493-4caf-a8b2-d55a605772cf None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:03.077415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac97f-c493-4caf-a8b2-d55a605772cf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:03.077555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac97f-c493-4caf-a8b2-d55a605772cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:03.143411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-582ac97f-c493-4caf-a8b2-d55a605772cf None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:03.144627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-582ac97f-c493-4caf-a8b2-d55a605772cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:03.201474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:03.244646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:03.290246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9e575-b7f5-4c59-b5f9-a8733624ed58 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:03.292953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9cd9e575-b7f5-4c59-b5f9-a8733624ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:03.450016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9e575-b7f5-4c59-b5f9-a8733624ed58 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:03.526519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:03.568031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f3286-6fb1-446b-a157-47595dedddad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:03.568843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3286-6fb1-446b-a157-47595dedddad service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:03.569132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3286-6fb1-446b-a157-47595dedddad service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:03.569408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3286-6fb1-446b-a157-47595dedddad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:03.571124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-893f3286-6fb1-446b-a157-47595dedddad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:03.664821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f3286-6fb1-446b-a157-47595dedddad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:03.666504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f3286-6fb1-446b-a157-47595dedddad service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:03.686050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 709/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:04.622226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd0b9-7270-4282-b88c-427f1a9c02d8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:04.622823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd0b9-7270-4282-b88c-427f1a9c02d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:04.622823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd0b9-7270-4282-b88c-427f1a9c02d8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:04.624165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:04.629330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2fc3-7e11-4bf6-bebf-559837fa7f41 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:04.629815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2fc3-7e11-4bf6-bebf-559837fa7f41 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:04.629939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2fc3-7e11-4bf6-bebf-559837fa7f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:04.708053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-456f2fc3-7e11-4bf6-bebf-559837fa7f41 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:04.709921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-456f2fc3-7e11-4bf6-bebf-559837fa7f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:04.737497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:04.809100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:04.966040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd0b9-7270-4282-b88c-427f1a9c02d8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:04.967812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a1ddd0b9-7270-4282-b88c-427f1a9c02d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:05.124575 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd0b9-7270-4282-b88c-427f1a9c02d8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:05.168123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:05.241369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9de3-85f4-41f8-b832-1bda2a8f5401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:05.242052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9de3-85f4-41f8-b832-1bda2a8f5401 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:05.242491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9de3-85f4-41f8-b832-1bda2a8f5401 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:05.242777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9de3-85f4-41f8-b832-1bda2a8f5401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:05.244445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b9af9de3-85f4-41f8-b832-1bda2a8f5401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:05.338411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af9de3-85f4-41f8-b832-1bda2a8f5401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:05.340057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af9de3-85f4-41f8-b832-1bda2a8f5401 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:05.360305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 709/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:06.263744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c31b6-b855-4303-a714-5dac80fd1f74 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:06.264594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c31b6-b855-4303-a714-5dac80fd1f74 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:06.264788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c31b6-b855-4303-a714-5dac80fd1f74 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:06.266416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:06.272159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d53e-d281-4bc2-ad8c-3327e0b90e76 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:06.273240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d53e-d281-4bc2-ad8c-3327e0b90e76 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:06.273240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d53e-d281-4bc2-ad8c-3327e0b90e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:06.329999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:06.353769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-71f1d53e-d281-4bc2-ad8c-3327e0b90e76 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:06.355002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-71f1d53e-d281-4bc2-ad8c-3327e0b90e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:06.456714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:06.609755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c31b6-b855-4303-a714-5dac80fd1f74 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:06.611259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f40c31b6-b855-4303-a714-5dac80fd1f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:06.788129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c31b6-b855-4303-a714-5dac80fd1f74 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:06.801247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:06.916325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7a3c2-c7a2-4f1a-aa84-9ce35218eed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:06.916976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a3c2-c7a2-4f1a-aa84-9ce35218eed4 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:06.917261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a3c2-c7a2-4f1a-aa84-9ce35218eed4 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:06.917537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a3c2-c7a2-4f1a-aa84-9ce35218eed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:06.919246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fad7a3c2-c7a2-4f1a-aa84-9ce35218eed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:07.012861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7a3c2-c7a2-4f1a-aa84-9ce35218eed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:07.014527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7a3c2-c7a2-4f1a-aa84-9ce35218eed4 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:07.033734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 712/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:07.916319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0da6e-79ba-422a-be1b-5865e2f4cd3e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:07.916864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0da6e-79ba-422a-be1b-5865e2f4cd3e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:07.916864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0da6e-79ba-422a-be1b-5865e2f4cd3e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:07.918277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:07.923334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7740e0-4d71-4111-9be1-ab772109e510 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:07.923772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7740e0-4d71-4111-9be1-ab772109e510 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:07.923925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7740e0-4d71-4111-9be1-ab772109e510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:07.943354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:08.003268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-eb7740e0-4d71-4111-9be1-ab772109e510 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:08.004506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eb7740e0-4d71-4111-9be1-ab772109e510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:08.106067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:08.256904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0da6e-79ba-422a-be1b-5865e2f4cd3e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:08.258460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-15f0da6e-79ba-422a-be1b-5865e2f4cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:08.371487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:08.410648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0da6e-79ba-422a-be1b-5865e2f4cd3e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:08.523537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149956d9-c68f-42fb-9a43-3ec95c56add4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:08.524197 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149956d9-c68f-42fb-9a43-3ec95c56add4 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:08.524487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149956d9-c68f-42fb-9a43-3ec95c56add4 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:08.524761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149956d9-c68f-42fb-9a43-3ec95c56add4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:08.526476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-149956d9-c68f-42fb-9a43-3ec95c56add4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:08.603308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:08.617407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149956d9-c68f-42fb-9a43-3ec95c56add4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:08.619060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149956d9-c68f-42fb-9a43-3ec95c56add4 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:08.638394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 712/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:09.523472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee18531-8682-4c09-bfc7-a980a1a34517 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:09.524035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee18531-8682-4c09-bfc7-a980a1a34517 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:09.524035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee18531-8682-4c09-bfc7-a980a1a34517 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:09.525469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:09.530914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a13f9-b270-4e04-a019-0cf7612ffd94 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:09.531558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a13f9-b270-4e04-a019-0cf7612ffd94 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:09.531558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a13f9-b270-4e04-a019-0cf7612ffd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:09.613216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-002a13f9-b270-4e04-a019-0cf7612ffd94 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:09.614989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-002a13f9-b270-4e04-a019-0cf7612ffd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:09.724314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:09.888433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee18531-8682-4c09-bfc7-a980a1a34517 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:09.889996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bee18531-8682-4c09-bfc7-a980a1a34517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:09.979041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:10.044020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee18531-8682-4c09-bfc7-a980a1a34517 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:10.170640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8361680-372f-4f03-bd66-725104b45c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:10.171206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8361680-372f-4f03-bd66-725104b45c89 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:10.171486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8361680-372f-4f03-bd66-725104b45c89 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:10.171757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8361680-372f-4f03-bd66-725104b45c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:10.173496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f8361680-372f-4f03-bd66-725104b45c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:10.229011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:10.271319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8361680-372f-4f03-bd66-725104b45c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:10.272954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8361680-372f-4f03-bd66-725104b45c89 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:10.291216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 715/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:11.162102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7d31-42b3-4ca0-8a52-dbb04500a6b9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:11.162745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7d31-42b3-4ca0-8a52-dbb04500a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:11.162745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7d31-42b3-4ca0-8a52-dbb04500a6b9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:11.164057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:11.169275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10043-bb06-460c-bcfd-31e5456f0cac None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:11.169739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10043-bb06-460c-bcfd-31e5456f0cac None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:11.170023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10043-bb06-460c-bcfd-31e5456f0cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:11.247719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-9ef10043-bb06-460c-bcfd-31e5456f0cac None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:11.248804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9ef10043-bb06-460c-bcfd-31e5456f0cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:11.350420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:11.501802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7d31-42b3-4ca0-8a52-dbb04500a6b9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:11.503296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-599a7d31-42b3-4ca0-8a52-dbb04500a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:11.555136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:11.653398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7d31-42b3-4ca0-8a52-dbb04500a6b9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:11.767206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d5a1e-c7c9-4d6b-bcd9-223063406589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:11.767765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d5a1e-c7c9-4d6b-bcd9-223063406589 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:11.768050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d5a1e-c7c9-4d6b-bcd9-223063406589 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:11.768325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d5a1e-c7c9-4d6b-bcd9-223063406589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:11.770007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-af8d5a1e-c7c9-4d6b-bcd9-223063406589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:11.777082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:11.862302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d5a1e-c7c9-4d6b-bcd9-223063406589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:11.863907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d5a1e-c7c9-4d6b-bcd9-223063406589 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:11.882242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 715/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:12.770138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a951-48e6-4999-91c4-99e4ab7e230b None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:12.771383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a951-48e6-4999-91c4-99e4ab7e230b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:12.771383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a951-48e6-4999-91c4-99e4ab7e230b None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:12.772693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:12.778100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f22e5-35a0-4446-b830-c1f06c66cb12 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:12.778534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f22e5-35a0-4446-b830-c1f06c66cb12 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:12.778637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f22e5-35a0-4446-b830-c1f06c66cb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:12.860615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3d0f22e5-35a0-4446-b830-c1f06c66cb12 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:12.862161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3d0f22e5-35a0-4446-b830-c1f06c66cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:12.938004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:12.969658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:13.125559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213a951-48e6-4999-91c4-99e4ab7e230b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:13.127368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d213a951-48e6-4999-91c4-99e4ab7e230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:13.148104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:13.299197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213a951-48e6-4999-91c4-99e4ab7e230b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:13.398371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:13.425411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16195bb-8467-44e6-8f87-5d307bdb313c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:13.426089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16195bb-8467-44e6-8f87-5d307bdb313c service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:13.426372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16195bb-8467-44e6-8f87-5d307bdb313c service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:13.426695 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16195bb-8467-44e6-8f87-5d307bdb313c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:13.430104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b16195bb-8467-44e6-8f87-5d307bdb313c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:13.528747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16195bb-8467-44e6-8f87-5d307bdb313c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:13.530519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16195bb-8467-44e6-8f87-5d307bdb313c service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:13.551222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 718/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:14.475438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc716-1f8e-4521-b52a-5fc2fb4d27e9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:14.476016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc716-1f8e-4521-b52a-5fc2fb4d27e9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:14.476174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc716-1f8e-4521-b52a-5fc2fb4d27e9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:14.477610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:14.482613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f569c-e8e6-4a03-869a-cf98cfde1a7e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:14.483055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f569c-e8e6-4a03-869a-cf98cfde1a7e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:14.483156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f569c-e8e6-4a03-869a-cf98cfde1a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:14.562311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4c6f569c-e8e6-4a03-869a-cf98cfde1a7e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:14.563547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4c6f569c-e8e6-4a03-869a-cf98cfde1a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:14.605743 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:14.661535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:14.813806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dc716-1f8e-4521-b52a-5fc2fb4d27e9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:14.815313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1c9dc716-1f8e-4521-b52a-5fc2fb4d27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:14.962835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dc716-1f8e-4521-b52a-5fc2fb4d27e9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:15.016880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:15.076336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c589a4-00a6-4694-89f8-ea15d07eae15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:15.076876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c589a4-00a6-4694-89f8-ea15d07eae15 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:15.077189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c589a4-00a6-4694-89f8-ea15d07eae15 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:15.077462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c589a4-00a6-4694-89f8-ea15d07eae15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:15.079432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e7c589a4-00a6-4694-89f8-ea15d07eae15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:15.170355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c589a4-00a6-4694-89f8-ea15d07eae15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:15.171977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c589a4-00a6-4694-89f8-ea15d07eae15 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:15.191708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 718/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:16.067466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9f2fb-37a9-4440-99d5-f729ea477d7e None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:16.068032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9f2fb-37a9-4440-99d5-f729ea477d7e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:16.068119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9f2fb-37a9-4440-99d5-f729ea477d7e None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:16.069498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:16.074626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b747b88-adad-4a31-9ca7-7920e9797166 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:16.075168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b747b88-adad-4a31-9ca7-7920e9797166 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:16.075168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b747b88-adad-4a31-9ca7-7920e9797166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:16.156588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2b747b88-adad-4a31-9ca7-7920e9797166 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:16.157872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2b747b88-adad-4a31-9ca7-7920e9797166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:16.159984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:16.263675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:16.419255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9f2fb-37a9-4440-99d5-f729ea477d7e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:16.421275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-03a9f2fb-37a9-4440-99d5-f729ea477d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:16.572922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9f2fb-37a9-4440-99d5-f729ea477d7e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:16.601273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:16.689344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9c35c-7198-4f06-8499-d1d38eb6a455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:16.690009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c35c-7198-4f06-8499-d1d38eb6a455 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:16.690294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c35c-7198-4f06-8499-d1d38eb6a455 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:16.690567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c35c-7198-4f06-8499-d1d38eb6a455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:16.692705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-18d9c35c-7198-4f06-8499-d1d38eb6a455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:16.786423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9c35c-7198-4f06-8499-d1d38eb6a455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:16.787964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9c35c-7198-4f06-8499-d1d38eb6a455 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:16.806790 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 721/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:18.748313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f5fb6-2c7a-447d-b338-7bc1ad3ac5e6 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:18.748873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f5fb6-2c7a-447d-b338-7bc1ad3ac5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:18.748873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f5fb6-2c7a-447d-b338-7bc1ad3ac5e6 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:18.750334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:18.756382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ffff-82d0-428a-8d29-7645ec58d9ce None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:18.756869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ffff-82d0-428a-8d29-7645ec58d9ce None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:18.756971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ffff-82d0-428a-8d29-7645ec58d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:18.797294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:18.824062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2215ffff-82d0-428a-8d29-7645ec58d9ce None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:18.825302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2215ffff-82d0-428a-8d29-7645ec58d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:18.926170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:18.973012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f5fb6-2c7a-447d-b338-7bc1ad3ac5e6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:18.974656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6b8f5fb6-2c7a-447d-b338-7bc1ad3ac5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:19.082890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f5fb6-2c7a-447d-b338-7bc1ad3ac5e6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:19.115882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:19.158733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea0b96-6a81-4de5-aa9b-8f3e179fa411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:19.159384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0b96-6a81-4de5-aa9b-8f3e179fa411 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:19.159672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0b96-6a81-4de5-aa9b-8f3e179fa411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:19.159952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0b96-6a81-4de5-aa9b-8f3e179fa411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:19.162122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b8ea0b96-6a81-4de5-aa9b-8f3e179fa411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:19.272288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea0b96-6a81-4de5-aa9b-8f3e179fa411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:19.273756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea0b96-6a81-4de5-aa9b-8f3e179fa411 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:19.291902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 721/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:21.581751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d06b7-c2ea-4778-b1aa-72d367150ea3 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:21.582284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d06b7-c2ea-4778-b1aa-72d367150ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:21.582413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d06b7-c2ea-4778-b1aa-72d367150ea3 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:21.583752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:21.589228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb1ad-0da9-44dc-9c47-634aeb6a132a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:21.589667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb1ad-0da9-44dc-9c47-634aeb6a132a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:21.589828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb1ad-0da9-44dc-9c47-634aeb6a132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:21.654693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3f2eb1ad-0da9-44dc-9c47-634aeb6a132a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:21.655917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3f2eb1ad-0da9-44dc-9c47-634aeb6a132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:21.669358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:21.755172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:21.793470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d06b7-c2ea-4778-b1aa-72d367150ea3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:21.795069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-098d06b7-c2ea-4778-b1aa-72d367150ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:21.900787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d06b7-c2ea-4778-b1aa-72d367150ea3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:21.913454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:21.975147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d1bb9-91fb-46d8-8a3d-209da86fbb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:21.975794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1bb9-91fb-46d8-8a3d-209da86fbb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:21.976076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1bb9-91fb-46d8-8a3d-209da86fbb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:21.976349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1bb9-91fb-46d8-8a3d-209da86fbb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:21.978053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3f3d1bb9-91fb-46d8-8a3d-209da86fbb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:22.087068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d1bb9-91fb-46d8-8a3d-209da86fbb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:22.088542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d1bb9-91fb-46d8-8a3d-209da86fbb0f service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:22.107846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 724/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:24.532462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ad9c-45bf-4e34-a6c9-4e9f7f906cec None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:24.533007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ad9c-45bf-4e34-a6c9-4e9f7f906cec None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:24.533132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ad9c-45bf-4e34-a6c9-4e9f7f906cec None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:24.534618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:24.540179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ec1eb-4847-4ee1-aa40-23dd56f086bd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:24.540661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ec1eb-4847-4ee1-aa40-23dd56f086bd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:24.540764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ec1eb-4847-4ee1-aa40-23dd56f086bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:24.590894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:24.610118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7f1ec1eb-4847-4ee1-aa40-23dd56f086bd None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:24.611329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7f1ec1eb-4847-4ee1-aa40-23dd56f086bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:24.710694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:24.751201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ad9c-45bf-4e34-a6c9-4e9f7f906cec None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:24.752775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5375ad9c-45bf-4e34-a6c9-4e9f7f906cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:24.859621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ad9c-45bf-4e34-a6c9-4e9f7f906cec None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:24.900948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:24.938718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed01604-d4af-4133-8892-3a6db1cf7811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:24.939377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01604-d4af-4133-8892-3a6db1cf7811 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:24.939655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01604-d4af-4133-8892-3a6db1cf7811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:24.939962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01604-d4af-4133-8892-3a6db1cf7811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:24.941644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ed01604-d4af-4133-8892-3a6db1cf7811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:25.053697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01604-d4af-4133-8892-3a6db1cf7811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:25.055156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01604-d4af-4133-8892-3a6db1cf7811 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:25.074358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 724/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:27.251215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4007c60-46eb-4d86-8132-c8096888776e None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:27.251757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4007c60-46eb-4d86-8132-c8096888776e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:27.251757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4007c60-46eb-4d86-8132-c8096888776e None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:27.253159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:27.259390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64e2bd-ee56-4c05-ba49-2b5f2576aa86 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:27.260000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64e2bd-ee56-4c05-ba49-2b5f2576aa86 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:27.260000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64e2bd-ee56-4c05-ba49-2b5f2576aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:27.325134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6d64e2bd-ee56-4c05-ba49-2b5f2576aa86 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:27.326396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6d64e2bd-ee56-4c05-ba49-2b5f2576aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:27.347262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:27.429788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:27.469196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4007c60-46eb-4d86-8132-c8096888776e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:27.470771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f4007c60-46eb-4d86-8132-c8096888776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:27.582581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4007c60-46eb-4d86-8132-c8096888776e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:27.603851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:27.662874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c30ea-c7bc-4e57-ac61-981936bab434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:27.663525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c30ea-c7bc-4e57-ac61-981936bab434 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:27.663813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c30ea-c7bc-4e57-ac61-981936bab434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:27.664090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c30ea-c7bc-4e57-ac61-981936bab434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:27.665826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cc4c30ea-c7bc-4e57-ac61-981936bab434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:27.777843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c30ea-c7bc-4e57-ac61-981936bab434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:27.779227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c30ea-c7bc-4e57-ac61-981936bab434 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:27.797124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 727/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:29.905996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4fab0-00b8-429d-bdd7-273b0d0757db None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:29.906547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4fab0-00b8-429d-bdd7-273b0d0757db None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:29.906547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4fab0-00b8-429d-bdd7-273b0d0757db None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:29.907969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:29.914198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d336531-014e-446d-8dc8-3c9b38d66076 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:29.914667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d336531-014e-446d-8dc8-3c9b38d66076 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:29.914780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d336531-014e-446d-8dc8-3c9b38d66076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:29.979490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:29.982296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4d336531-014e-446d-8dc8-3c9b38d66076 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:29.983574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4d336531-014e-446d-8dc8-3c9b38d66076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:30.081636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:30.120837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4fab0-00b8-429d-bdd7-273b0d0757db None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:30.122391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d4b4fab0-00b8-429d-bdd7-273b0d0757db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:30.231500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4fab0-00b8-429d-bdd7-273b0d0757db None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:30.281415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:30.306479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a457b62-2c91-4ed9-a804-eef2a04e07d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:30.307122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457b62-2c91-4ed9-a804-eef2a04e07d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:30.307408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457b62-2c91-4ed9-a804-eef2a04e07d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:30.307676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457b62-2c91-4ed9-a804-eef2a04e07d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:30.309324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8a457b62-2c91-4ed9-a804-eef2a04e07d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:30.419236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a457b62-2c91-4ed9-a804-eef2a04e07d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:30.420684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a457b62-2c91-4ed9-a804-eef2a04e07d0 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:30.439194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 727/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:32.517491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38cc9-1f11-4534-ac05-41b4f66051f4 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:32.518116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38cc9-1f11-4534-ac05-41b4f66051f4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:32.518116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38cc9-1f11-4534-ac05-41b4f66051f4 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:32.519450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:32.525952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424c6-721c-47b3-a4a9-c26dc13bdad4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:32.525952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424c6-721c-47b3-a4a9-c26dc13bdad4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:32.526421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424c6-721c-47b3-a4a9-c26dc13bdad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:32.593257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a16424c6-721c-47b3-a4a9-c26dc13bdad4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:32.594519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a16424c6-721c-47b3-a4a9-c26dc13bdad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:32.626508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:32.696358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:32.734215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38cc9-1f11-4534-ac05-41b4f66051f4 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:32.735783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4ca38cc9-1f11-4534-ac05-41b4f66051f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:32.844458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38cc9-1f11-4534-ac05-41b4f66051f4 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:32.873160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:32.919051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd5e92-29ba-400d-9c6d-46103fa84560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:32.919703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5e92-29ba-400d-9c6d-46103fa84560 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:32.919984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5e92-29ba-400d-9c6d-46103fa84560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:32.920263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5e92-29ba-400d-9c6d-46103fa84560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:32.921957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e1fd5e92-29ba-400d-9c6d-46103fa84560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:33.032558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd5e92-29ba-400d-9c6d-46103fa84560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:33.034050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd5e92-29ba-400d-9c6d-46103fa84560 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:33.052825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 730/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:35.155994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edabda8-33ed-476b-ab3c-5196c53422dd None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:35.156572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edabda8-33ed-476b-ab3c-5196c53422dd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:35.156821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edabda8-33ed-476b-ab3c-5196c53422dd None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:35.158310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:35.164862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b49c8-226f-47fd-8b09-4d501be05fd3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:35.165472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b49c8-226f-47fd-8b09-4d501be05fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:35.165472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b49c8-226f-47fd-8b09-4d501be05fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:35.242214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-046b49c8-226f-47fd-8b09-4d501be05fd3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:35.243429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-046b49c8-226f-47fd-8b09-4d501be05fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:35.252882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:35.358672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:35.403955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edabda8-33ed-476b-ab3c-5196c53422dd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:35.405519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6edabda8-33ed-476b-ab3c-5196c53422dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:35.541687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edabda8-33ed-476b-ab3c-5196c53422dd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:35.608381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:35.635803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc10cb-ffd0-415d-9a93-e79fb7dee03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:35.636519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc10cb-ffd0-415d-9a93-e79fb7dee03c service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:35.636801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc10cb-ffd0-415d-9a93-e79fb7dee03c service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:35.637501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc10cb-ffd0-415d-9a93-e79fb7dee03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:35.639211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-85fc10cb-ffd0-415d-9a93-e79fb7dee03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:35.753273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc10cb-ffd0-415d-9a93-e79fb7dee03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:35.755356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc10cb-ffd0-415d-9a93-e79fb7dee03c service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:35.773592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 730/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:37.882122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a3a8-1d50-4791-a46b-e1ec4636a5b5 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:37.882794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a3a8-1d50-4791-a46b-e1ec4636a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:37.882794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a3a8-1d50-4791-a46b-e1ec4636a5b5 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:37.884032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:39:37.889857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b619c-4bc4-407e-9bb1-af451ac110a4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:37.890337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b619c-4bc4-407e-9bb1-af451ac110a4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:37.890420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b619c-4bc4-407e-9bb1-af451ac110a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:37.964127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ff6b619c-4bc4-407e-9bb1-af451ac110a4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:37.965351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ff6b619c-4bc4-407e-9bb1-af451ac110a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:38.007902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:38.067654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:38.106736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807a3a8-1d50-4791-a46b-e1ec4636a5b5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:38.108332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3807a3a8-1d50-4791-a46b-e1ec4636a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:38.219753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807a3a8-1d50-4791-a46b-e1ec4636a5b5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:38.258791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:38.295595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e536725-4aaf-430a-8389-6dd33fb6bb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:38.296244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536725-4aaf-430a-8389-6dd33fb6bb20 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:38.296528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536725-4aaf-430a-8389-6dd33fb6bb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:38.296808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536725-4aaf-430a-8389-6dd33fb6bb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:38.298491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7e536725-4aaf-430a-8389-6dd33fb6bb20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:38.410227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e536725-4aaf-430a-8389-6dd33fb6bb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:38.411584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e536725-4aaf-430a-8389-6dd33fb6bb20 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:38.431187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 733/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:40.515449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898078-cc98-4fb9-a994-8464896b2958 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:40.516100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898078-cc98-4fb9-a994-8464896b2958 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:40.516100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898078-cc98-4fb9-a994-8464896b2958 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:40.517372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:40.523511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d983-6c21-446d-bf21-830218a73cb4 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:40.524006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d983-6c21-446d-bf21-830218a73cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:40.524102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d983-6c21-446d-bf21-830218a73cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:40.590676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d7c8d983-6c21-446d-bf21-830218a73cb4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:40.591899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d7c8d983-6c21-446d-bf21-830218a73cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:40.610114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:40.696946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:40.734544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7898078-cc98-4fb9-a994-8464896b2958 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:40.736132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d7898078-cc98-4fb9-a994-8464896b2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:40.844710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7898078-cc98-4fb9-a994-8464896b2958 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:40.913599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:40.920638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e8f61-9e5b-4a87-8f9a-46a41db004e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:40.921293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8f61-9e5b-4a87-8f9a-46a41db004e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:40.921592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8f61-9e5b-4a87-8f9a-46a41db004e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:40.921881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8f61-9e5b-4a87-8f9a-46a41db004e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:40.923645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6c5e8f61-9e5b-4a87-8f9a-46a41db004e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:41.043189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e8f61-9e5b-4a87-8f9a-46a41db004e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:41.044639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e8f61-9e5b-4a87-8f9a-46a41db004e6 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:41.063626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 733/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:43.126363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75ab2-dcef-459d-8d5e-182ee8a47b39 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:43.126950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75ab2-dcef-459d-8d5e-182ee8a47b39 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:43.126950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75ab2-dcef-459d-8d5e-182ee8a47b39 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:43.128270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:39:43.134949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661077-64f6-48b3-8c78-f25a6d1cb12f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:43.135445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661077-64f6-48b3-8c78-f25a6d1cb12f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:43.135548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661077-64f6-48b3-8c78-f25a6d1cb12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:43.206102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-61661077-64f6-48b3-8c78-f25a6d1cb12f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:39:43.207397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-61661077-64f6-48b3-8c78-f25a6d1cb12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:43.258823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:43.310286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:39:43.348361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b75ab2-dcef-459d-8d5e-182ee8a47b39 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:39:43.349935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-99b75ab2-dcef-459d-8d5e-182ee8a47b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:43.577166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b75ab2-dcef-459d-8d5e-182ee8a47b39 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:39:43.631756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:43.658700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d00ff-818e-4ad8-9032-fbea512c27e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:39:43.659372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d00ff-818e-4ad8-9032-fbea512c27e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:39:43.660250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d00ff-818e-4ad8-9032-fbea512c27e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:39:43.660535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d00ff-818e-4ad8-9032-fbea512c27e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:39:43.662238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-472d00ff-818e-4ad8-9032-fbea512c27e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:39:43.771677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d00ff-818e-4ad8-9032-fbea512c27e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:39:43.773134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d00ff-818e-4ad8-9032-fbea512c27e5 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:39:43.791206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 736/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:53.308351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=22 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:39:53.788895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=66 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:03.746887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a76135-2207-4426-b6c9-792c0bd9b251 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:03.747427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a76135-2207-4426-b6c9-792c0bd9b251 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:03.747427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a76135-2207-4426-b6c9-792c0bd9b251 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:03.748729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 735/1471] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:40:03.754867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7ca25-1daf-4aa2-b633-05b033d72092 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:03.755360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7ca25-1daf-4aa2-b633-05b033d72092 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:03.755451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7ca25-1daf-4aa2-b633-05b033d72092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:03.823313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4ef7ca25-1daf-4aa2-b633-05b033d72092 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:03.824530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4ef7ca25-1daf-4aa2-b633-05b033d72092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:03.929575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 737/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:40:03.980842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4086-f309-493d-8226-523b8f33b134 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:03.981074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4086-f309-493d-8226-523b8f33b134 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:03.981361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4086-f309-493d-8226-523b8f33b134 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:03.982922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 736/1473] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 08:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:40:03.988345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a38bd-1383-4e57-a400-9a9f2285345d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:03.988631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a38bd-1383-4e57-a400-9a9f2285345d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:03.988910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a38bd-1383-4e57-a400-9a9f2285345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:04.066450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f77a38bd-1383-4e57-a400-9a9f2285345d None None] MFA Rules not processed for user `ec22f82d0e7745f282c5837459fba05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:04.067663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f77a38bd-1383-4e57-a400-9a9f2285345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:04.088314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:04.145209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 738/1474] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 08:40:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:40:04.152916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af4086-f309-493d-8226-523b8f33b134 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:40:04.154530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e3af4086-f309-493d-8226-523b8f33b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:04.265393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af4086-f309-493d-8226-523b8f33b134 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:40:04.340229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfe5d1-4c44-4d7b-b439-7b75a7d19dca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:40:04.340797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfe5d1-4c44-4d7b-b439-7b75a7d19dca service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:04.341083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfe5d1-4c44-4d7b-b439-7b75a7d19dca service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:04.341362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfe5d1-4c44-4d7b-b439-7b75a7d19dca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:04.343049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6bdfe5d1-4c44-4d7b-b439-7b75a7d19dca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:04.401810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:04.459421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfe5d1-4c44-4d7b-b439-7b75a7d19dca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:40:04.460876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfe5d1-4c44-4d7b-b439-7b75a7d19dca service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:40:04.479847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 737/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:40:06.646733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047483cb-e52a-48ba-9cf1-1cb769f152ca None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:06.647301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047483cb-e52a-48ba-9cf1-1cb769f152ca None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:06.647301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047483cb-e52a-48ba-9cf1-1cb769f152ca None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:06.648673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 739/1476] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:40:06.654226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f9a88-22d6-4a7a-87b3-4555949a1c51 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:06.654677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f9a88-22d6-4a7a-87b3-4555949a1c51 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:06.654793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f9a88-22d6-4a7a-87b3-4555949a1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:06.721262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-099f9a88-22d6-4a7a-87b3-4555949a1c51 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:06.722744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-099f9a88-22d6-4a7a-87b3-4555949a1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:06.819072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 738/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:40:06.843716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047483cb-e52a-48ba-9cf1-1cb769f152ca None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:40:06.845268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-047483cb-e52a-48ba-9cf1-1cb769f152ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:06.973205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047483cb-e52a-48ba-9cf1-1cb769f152ca None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:40:07.023126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:07.067871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1fb87-5677-4827-8e71-88ef2b3823be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:40:07.068533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1fb87-5677-4827-8e71-88ef2b3823be admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:07.068812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1fb87-5677-4827-8e71-88ef2b3823be admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:07.069135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1fb87-5677-4827-8e71-88ef2b3823be admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:07.069846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1fb87-5677-4827-8e71-88ef2b3823be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:40:07.071587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-e6c1fb87-5677-4827-8e71-88ef2b3823be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:40:07.071587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:40:07.071587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:40:07.072730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1fb87-5677-4827-8e71-88ef2b3823be admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:40:07.092660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 740/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 08:40:06 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:40:09.145314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5251af-add8-46e9-be49-ab9ef7e2971d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:09.145979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5251af-add8-46e9-be49-ab9ef7e2971d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:09.145979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5251af-add8-46e9-be49-ab9ef7e2971d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:09.147347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 739/1479] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:40:09.153347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8e02-69c2-4c86-b5e2-be15b2931e21 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:09.153949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8e02-69c2-4c86-b5e2-be15b2931e21 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:09.153949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8e02-69c2-4c86-b5e2-be15b2931e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:09.225593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-515c8e02-69c2-4c86-b5e2-be15b2931e21 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:09.226852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-515c8e02-69c2-4c86-b5e2-be15b2931e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:09.326914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 741/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:40:09.370625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5251af-add8-46e9-be49-ab9ef7e2971d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:40:09.372161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4f5251af-add8-46e9-be49-ab9ef7e2971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:09.383201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:09.525227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5251af-add8-46e9-be49-ab9ef7e2971d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:40:09.610035 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:09.644754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604da1f0-31f0-4571-ac70-9f42f67ab738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:40:09.645414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604da1f0-31f0-4571-ac70-9f42f67ab738 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:09.645725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604da1f0-31f0-4571-ac70-9f42f67ab738 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:09.646008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604da1f0-31f0-4571-ac70-9f42f67ab738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:09.647745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-604da1f0-31f0-4571-ac70-9f42f67ab738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:09.738465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604da1f0-31f0-4571-ac70-9f42f67ab738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:40:09.740073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604da1f0-31f0-4571-ac70-9f42f67ab738 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:40:09.758234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 740/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:40:12.001225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c93d9-e4be-4da4-bc4d-822140a3dd33 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:12.002468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c93d9-e4be-4da4-bc4d-822140a3dd33 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:12.002468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c93d9-e4be-4da4-bc4d-822140a3dd33 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:12.003867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 742/1482] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:40:12.009400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40a60-a297-4713-ba45-b1e0a55910ec None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:12.009920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40a60-a297-4713-ba45-b1e0a55910ec None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:12.010023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40a60-a297-4713-ba45-b1e0a55910ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:12.075686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-43f40a60-a297-4713-ba45-b1e0a55910ec None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:12.076901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-43f40a60-a297-4713-ba45-b1e0a55910ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:12.123519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:12.177202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 741/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:40:12.215058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c93d9-e4be-4da4-bc4d-822140a3dd33 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:40:12.216610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bd5c93d9-e4be-4da4-bc4d-822140a3dd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:12.240951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:12.324160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c93d9-e4be-4da4-bc4d-822140a3dd33 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:40:12.402199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4e9d-4ea6-4121-a023-b07c7f97c749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:40:12.402856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4e9d-4ea6-4121-a023-b07c7f97c749 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:12.403142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4e9d-4ea6-4121-a023-b07c7f97c749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:12.403420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4e9d-4ea6-4121-a023-b07c7f97c749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:12.405122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a6ae4e9d-4ea6-4121-a023-b07c7f97c749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:12.492673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:12.538469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4e9d-4ea6-4121-a023-b07c7f97c749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:40:12.540014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4e9d-4ea6-4121-a023-b07c7f97c749 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:40:12.562024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 743/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:40:14.740241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1fde-a806-4755-89b9-fa33b622f9ae None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:14.740808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1fde-a806-4755-89b9-fa33b622f9ae None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:14.740808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1fde-a806-4755-89b9-fa33b622f9ae None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:14.742346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 742/1485] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:40:14.748130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003fd04-c522-4cbe-ad62-da303bd3650b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:14.753633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003fd04-c522-4cbe-ad62-da303bd3650b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:14.753633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003fd04-c522-4cbe-ad62-da303bd3650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:14.828898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1003fd04-c522-4cbe-ad62-da303bd3650b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:14.830451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1003fd04-c522-4cbe-ad62-da303bd3650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:14.935605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 744/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:40:14.975472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf1fde-a806-4755-89b9-fa33b622f9ae None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:40:14.977023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ccdf1fde-a806-4755-89b9-fa33b622f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:15.084379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf1fde-a806-4755-89b9-fa33b622f9ae None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:40:15.163099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:15.165146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a0840-1396-4472-97b5-e87c30cf08e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:40:15.165827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0840-1396-4472-97b5-e87c30cf08e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:15.166109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0840-1396-4472-97b5-e87c30cf08e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:15.166379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0840-1396-4472-97b5-e87c30cf08e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:15.168070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-382a0840-1396-4472-97b5-e87c30cf08e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:15.294369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a0840-1396-4472-97b5-e87c30cf08e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:40:15.295828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a0840-1396-4472-97b5-e87c30cf08e1 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:40:15.316730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 743/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:40:17.464876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8ecc-ade4-4b70-adea-9e1510259ed4 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:17.465461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8ecc-ade4-4b70-adea-9e1510259ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:17.465461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8ecc-ade4-4b70-adea-9e1510259ed4 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:17.466861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 745/1488] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:40:17.473586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d8b53-9ba2-4109-ae94-2208099ae4ac None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:17.474147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d8b53-9ba2-4109-ae94-2208099ae4ac None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:17.474333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d8b53-9ba2-4109-ae94-2208099ae4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:17.544818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-431d8b53-9ba2-4109-ae94-2208099ae4ac None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:17.546106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-431d8b53-9ba2-4109-ae94-2208099ae4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:17.604378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:17.651346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 744/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:40:17.694601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b8ecc-ade4-4b70-adea-9e1510259ed4 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:40:17.696166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3e8b8ecc-ade4-4b70-adea-9e1510259ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:17.733618 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:17.806256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b8ecc-ade4-4b70-adea-9e1510259ed4 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:40:17.886510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8c519-7f43-41cf-b95f-daaf1f1e4381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:40:17.887212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8c519-7f43-41cf-b95f-daaf1f1e4381 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:17.887499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8c519-7f43-41cf-b95f-daaf1f1e4381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:17.887779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8c519-7f43-41cf-b95f-daaf1f1e4381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:17.889462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3ac8c519-7f43-41cf-b95f-daaf1f1e4381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:17.973065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:18.003690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8c519-7f43-41cf-b95f-daaf1f1e4381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:40:18.005227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8c519-7f43-41cf-b95f-daaf1f1e4381 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:40:18.024660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 746/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:40:20.434072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78f3e-9c3f-4416-aef0-b2c9ed4c8dcd None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:20.434636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78f3e-9c3f-4416-aef0-b2c9ed4c8dcd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:20.434753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78f3e-9c3f-4416-aef0-b2c9ed4c8dcd None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:20.436073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 745/1491] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 08:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:40:20.441401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670acab-0d8c-4c63-b4ef-e511b8be7cf0 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:20.441866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670acab-0d8c-4c63-b4ef-e511b8be7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:20.441972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670acab-0d8c-4c63-b4ef-e511b8be7cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:20.508124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1670acab-0d8c-4c63-b4ef-e511b8be7cf0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:40:20.509341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1670acab-0d8c-4c63-b4ef-e511b8be7cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:20.608629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 747/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 08:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:40:20.649021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d78f3e-9c3f-4416-aef0-b2c9ed4c8dcd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:40:20.650999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-92d78f3e-9c3f-4416-aef0-b2c9ed4c8dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:20.755112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d78f3e-9c3f-4416-aef0-b2c9ed4c8dcd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:40:20.827946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195dcf4-17c0-4415-a0cc-cb7cc92f3add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:40:20.828599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195dcf4-17c0-4415-a0cc-cb7cc92f3add service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:40:20.828887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195dcf4-17c0-4415-a0cc-cb7cc92f3add service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:40:20.829167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195dcf4-17c0-4415-a0cc-cb7cc92f3add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:40:20.830997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3195dcf4-17c0-4415-a0cc-cb7cc92f3add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:40:20.840816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:20.942706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195dcf4-17c0-4415-a0cc-cb7cc92f3add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:40:20.944152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195dcf4-17c0-4415-a0cc-cb7cc92f3add service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:40:20.962284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 746/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:40:30.606785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=82 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:30.959887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=50 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:42:14.868034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3307-5e5a-4e0a-b0d8-59943cc1132a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:14.868656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3307-5e5a-4e0a-b0d8-59943cc1132a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:14.868656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3307-5e5a-4e0a-b0d8-59943cc1132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:14.951291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a9fb3307-5e5a-4e0a-b0d8-59943cc1132a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:42:14.952514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a9fb3307-5e5a-4e0a-b0d8-59943cc1132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:42:15.060823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 748/1494] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:42:15.069442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446f31-8b9f-4cc8-b0f7-319679e643fd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.069975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446f31-8b9f-4cc8-b0f7-319679e643fd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.070081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446f31-8b9f-4cc8-b0f7-319679e643fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.089430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-50446f31-8b9f-4cc8-b0f7-319679e643fd None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:42:15.090667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-50446f31-8b9f-4cc8-b0f7-319679e643fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:42:15.099649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 747/1495] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:42:15.107659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb3307-5e5a-4e0a-b0d8-59943cc1132a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:15.118351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb3307-5e5a-4e0a-b0d8-59943cc1132a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:15.123692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:15.124361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.124642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.124916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.125783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:42:15.126151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:15.127847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:15.127847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:42:15.127847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:42:15.128971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:15.141590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 749/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:42:15.149930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446f31-8b9f-4cc8-b0f7-319679e643fd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:15.160766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446f31-8b9f-4cc8-b0f7-319679e643fd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:15.166209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:15.166878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.167158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.167429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.168132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:15.169929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:15.169929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 18 08:42:15.169929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: Jul 18 08:42:15.171132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:15.386013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 748/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:42:15 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:42:15.390123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:15.400971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141b0d-d44d-4075-bd22-be5f14f17ab9 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:15.450918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:42:15.458598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:15.463756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.463756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.463756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.463756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:15.463756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:15.463756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:42:15.463756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:42:15.464431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:15.565219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 750/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:42:15 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:42:15.569576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:15.581844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2587ce-2c20-41d9-81d9-8670b3e06046 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:15.587087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:15.587790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.588069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.588339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.589061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:15.590107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:15.590107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 18 08:42:15.590107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: Jul 18 08:42:15.591022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:15.606192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 749/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:42:15.610294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:15.620824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a274fb-3f5f-4cd6-876b-8e13b8ee56cd admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:15.625508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e413c-90e0-4fb2-9260-a0c59603541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:15.626259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e413c-90e0-4fb2-9260-a0c59603541d admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.626544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e413c-90e0-4fb2-9260-a0c59603541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.626821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e413c-90e0-4fb2-9260-a0c59603541d admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.628390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e413c-90e0-4fb2-9260-a0c59603541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:15.629430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-f61e413c-90e0-4fb2-9260-a0c59603541d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:15.629430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:42:15.629430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:42:15.630411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e413c-90e0-4fb2-9260-a0c59603541d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:15.645391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 751/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:42:15.650635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:15.662385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc383dad-ab23-4bf9-b7a9-367a4572b28a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:15.667109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb7410-b059-4383-95a3-8edc91f470c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:15.668003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7410-b059-4383-95a3-8edc91f470c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.668287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7410-b059-4383-95a3-8edc91f470c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.668562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7410-b059-4383-95a3-8edc91f470c6 admin admin] PATH_INFO: `/v3/projects/9a288b9f6d5946e4a33e2c0e488230b6/users/03daa103e1b74a928f9aa98e7e838e7f/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.684355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7410-b059-4383-95a3-8edc91f470c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a288b9f6d5946e4a33e2c0e488230b6, user_id=03daa103e1b74a928f9aa98e7e838e7f, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:15.685396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-d2eb7410-b059-4383-95a3-8edc91f470c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:15.685396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 18 08:42:15.685396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: Jul 18 08:42:15.687399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7410-b059-4383-95a3-8edc91f470c6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:15.771208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 750/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:42:15 2022] PUT /identity/v3/projects/9a288b9f6d5946e4a33e2c0e488230b6/users/03daa103e1b74a928f9aa98e7e838e7f/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:42:15.784389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f479a0-85b4-4d7e-82a5-22e873cca145 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.784666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f479a0-85b4-4d7e-82a5-22e873cca145 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.784949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f479a0-85b4-4d7e-82a5-22e873cca145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.812039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-71f479a0-85b4-4d7e-82a5-22e873cca145 None None] MFA Rules not processed for user `03daa103e1b74a928f9aa98e7e838e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:42:15.813269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-71f479a0-85b4-4d7e-82a5-22e873cca145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:42:15.881129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 752/1502] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:42:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:42:15.894504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebf3a-59de-42e5-8bba-ca3cea25befc None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.894797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebf3a-59de-42e5-8bba-ca3cea25befc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.895076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebf3a-59de-42e5-8bba-ca3cea25befc None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.896515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 751/1503] 10.222.0.39 () {54 vars in 964 bytes} [Mon Jul 18 08:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:42:15.901404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9e476-cb91-41e7-a5ca-c47332a6f7cc None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:15.901721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9e476-cb91-41e7-a5ca-c47332a6f7cc None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:15.902005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9e476-cb91-41e7-a5ca-c47332a6f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:15.964229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a7e9e476-cb91-41e7-a5ca-c47332a6f7cc None None] MFA Rules not processed for user `b8d2f745ac2a4388a7890250141a4e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:42:15.965464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a7e9e476-cb91-41e7-a5ca-c47332a6f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:42:16.042726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 753/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Jul 18 08:42:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:42:16.051285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ebf3a-59de-42e5-8bba-ca3cea25befc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:16.061987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ebf3a-59de-42e5-8bba-ca3cea25befc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:16.065494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:16.066162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:16.066446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:16.066718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:16.075586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:16.077092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:16.086802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 752/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:42:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:42:16.132270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e43-a71b-4ea7-9299-2e9833346666 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:16.132652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e43-a71b-4ea7-9299-2e9833346666 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:16.133155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e43-a71b-4ea7-9299-2e9833346666 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:16.134803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 754/1506] 10.222.0.39 () {52 vars in 829 bytes} [Mon Jul 18 08:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:42:16.138994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:16.208248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732798ad-9d1a-4f28-b08f-1a12ef8a21d3 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:16.213288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:16.214215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:16.214498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:16.214771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] PATH_INFO: `/v3/users/03daa103e1b74a928f9aa98e7e838e7f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:16.216104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03daa103e1b74a928f9aa98e7e838e7f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:16.217163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:16.217163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 18 08:42:16.217163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: Jul 18 08:42:16.218428 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:16.465661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03daa103e1b74a928f9aa98e7e838e7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:16.467064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03daa103e1b74a928f9aa98e7e838e7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:16.486045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03daa103e1b74a928f9aa98e7e838e7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:16.498303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03daa103e1b74a928f9aa98e7e838e7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:16.499152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03daa103e1b74a928f9aa98e7e838e7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:16.503352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:42:16.580932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 753/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:42:16 2022] DELETE /identity/v3/users/03daa103e1b74a928f9aa98e7e838e7f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:42:16.585948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:16.586271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:16.586565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:16.605217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:42:16.606482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:42:16.616459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:42:16.668071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 755/1508] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:42:16.678126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:16.679562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:42:16.764047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998764c7-4498-464d-9f7e-c7f3ef52676a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:16.768629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff7ef2-3c76-42b8-8ebf-3578befc85c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:16.769363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff7ef2-3c76-42b8-8ebf-3578befc85c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:16.769669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff7ef2-3c76-42b8-8ebf-3578befc85c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:16.769978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff7ef2-3c76-42b8-8ebf-3578befc85c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:16.779842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff7ef2-3c76-42b8-8ebf-3578befc85c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:16.781510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff7ef2-3c76-42b8-8ebf-3578befc85c0 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:16.794097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 754/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:42:17.279194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:42:17.279194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:42:17.290413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369fe1d-6aef-4bf3-8610-e8e137833583 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:42:17.295449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:42:17.296315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:42:17.296592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:42:17.296869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] PATH_INFO: `/v3/projects/9a288b9f6d5946e4a33e2c0e488230b6` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:42:17.298321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a288b9f6d5946e4a33e2c0e488230b6)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:42:17.300061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:42:17.300061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:42:17.300061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:42:17.301619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:42:17.431748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a288b9f6d5946e4a33e2c0e488230b6', 'request_id': 'req-5e6cd81a-96ff-42dc-9344-a4946f5ad795'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:17.438931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a288b9f6d5946e4a33e2c0e488230b6', 'request_id': 'req-5e6cd81a-96ff-42dc-9344-a4946f5ad795'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:17.454230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a288b9f6d5946e4a33e2c0e488230b6', 'request_id': 'req-5e6cd81a-96ff-42dc-9344-a4946f5ad795'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:17.519157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] The token cache is being invalidate because project 9a288b9f6d5946e4a33e2c0e488230b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:42:17.519458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:17.520260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e6cd81a-96ff-42dc-9344-a4946f5ad795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:42:17.521888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 756/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:42:17 2022] DELETE /identity/v3/projects/9a288b9f6d5946e4a33e2c0e488230b6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:42:26.787937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:42:27.515133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:44:01.104482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb0c10-1d09-4bb2-aaf3-acd19c3736c4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:01.105098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb0c10-1d09-4bb2-aaf3-acd19c3736c4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:01.105098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb0c10-1d09-4bb2-aaf3-acd19c3736c4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:01.106517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:44:01.112165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79f8a-1d5d-4ab8-8bd4-78cd6b68825a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:01.112594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79f8a-1d5d-4ab8-8bd4-78cd6b68825a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:01.112728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79f8a-1d5d-4ab8-8bd4-78cd6b68825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:01.131287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3db79f8a-1d5d-4ab8-8bd4-78cd6b68825a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:01.132493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3db79f8a-1d5d-4ab8-8bd4-78cd6b68825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:01.192970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:01.346384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb0c10-1d09-4bb2-aaf3-acd19c3736c4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:01.350215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-edbb0c10-1d09-4bb2-aaf3-acd19c3736c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:01.449341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb0c10-1d09-4bb2-aaf3-acd19c3736c4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:01.455186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa39fb4-a475-409e-835c-78292bb6e5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:01.455831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39fb4-a475-409e-835c-78292bb6e5a3 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:01.456371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39fb4-a475-409e-835c-78292bb6e5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:01.456646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39fb4-a475-409e-835c-78292bb6e5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:01.464932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa39fb4-a475-409e-835c-78292bb6e5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:01.466560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa39fb4-a475-409e-835c-78292bb6e5a3 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:01.476945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 756/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:02.316837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3877e8a-9d92-46c4-8822-c2becf885581 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:02.317428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3877e8a-9d92-46c4-8822-c2becf885581 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:02.317428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3877e8a-9d92-46c4-8822-c2becf885581 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:02.318822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:44:02.324073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035782c-c774-44d8-b308-8b303c5c1c33 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:02.324519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035782c-c774-44d8-b308-8b303c5c1c33 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:02.324707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035782c-c774-44d8-b308-8b303c5c1c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:02.344552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6035782c-c774-44d8-b308-8b303c5c1c33 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:02.345814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6035782c-c774-44d8-b308-8b303c5c1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:02.354037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:02.510207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3877e8a-9d92-46c4-8822-c2becf885581 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:02.525342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3877e8a-9d92-46c4-8822-c2becf885581 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:02.531791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0a17-329f-427d-91c6-d640b5d782be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:02.532446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0a17-329f-427d-91c6-d640b5d782be service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:02.532730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0a17-329f-427d-91c6-d640b5d782be service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:02.533007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0a17-329f-427d-91c6-d640b5d782be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:02.541824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0a17-329f-427d-91c6-d640b5d782be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:02.543488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0a17-329f-427d-91c6-d640b5d782be service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:02.554041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 759/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:03.853082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043953de-982a-437d-a91a-b8192a84a5e6 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:03.853589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043953de-982a-437d-a91a-b8192a84a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:03.853963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043953de-982a-437d-a91a-b8192a84a5e6 None None] PATH_INFO: `/v3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:03.855545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 758/1517] 10.222.0.26 () {54 vars in 925 bytes} [Mon Jul 18 08:44:03 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:44:03.875772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32256a7-2acd-46c0-b028-20205c8b1ce6 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:03.876275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32256a7-2acd-46c0-b028-20205c8b1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:03.876615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32256a7-2acd-46c0-b028-20205c8b1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:03.926474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f32256a7-2acd-46c0-b028-20205c8b1ce6 None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:03.927695 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f32256a7-2acd-46c0-b028-20205c8b1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:04.000059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 760/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Jul 18 08:44:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:08.233709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fd88-bfa0-4682-9932-80d0267c5648 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:08.234877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fd88-bfa0-4682-9932-80d0267c5648 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:08.234877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fd88-bfa0-4682-9932-80d0267c5648 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:08.236310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 759/1519] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 08:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:44:08.241312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec023fc-ad42-4b88-ad77-862bac3d7ee3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:08.241825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec023fc-ad42-4b88-ad77-862bac3d7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:08.241933 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec023fc-ad42-4b88-ad77-862bac3d7ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:08.260336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-aec023fc-ad42-4b88-ad77-862bac3d7ee3 None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:08.261556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-aec023fc-ad42-4b88-ad77-862bac3d7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:08.271059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 761/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 08:44:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:08.278772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793fd88-bfa0-4682-9932-80d0267c5648 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:08.292978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793fd88-bfa0-4682-9932-80d0267c5648 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:08.298772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ff2b2-2728-4e16-ae98-27070ae20824 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:08.299409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff2b2-2728-4e16-ae98-27070ae20824 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:08.299692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff2b2-2728-4e16-ae98-27070ae20824 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:08.299964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff2b2-2728-4e16-ae98-27070ae20824 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:08.308834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ff2b2-2728-4e16-ae98-27070ae20824 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:08.310467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ff2b2-2728-4e16-ae98-27070ae20824 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:08.320822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 760/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:13.811586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fff3-5fe9-4ecf-8354-e42d3996d1dd None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:13.812845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fff3-5fe9-4ecf-8354-e42d3996d1dd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:13.812845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fff3-5fe9-4ecf-8354-e42d3996d1dd None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:13.814171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:44:13.819192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4293ab-f212-4709-a675-9c8181f20136 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:13.819746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4293ab-f212-4709-a675-9c8181f20136 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:13.819746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4293ab-f212-4709-a675-9c8181f20136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:13.838502 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0a4293ab-f212-4709-a675-9c8181f20136 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:13.839770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0a4293ab-f212-4709-a675-9c8181f20136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:13.848147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:14.002000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fff3-5fe9-4ecf-8354-e42d3996d1dd None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:14.017139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fff3-5fe9-4ecf-8354-e42d3996d1dd None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:14.022934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100c4f4-72a7-4128-8b93-7f64c3ffb01e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:14.023578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c4f4-72a7-4128-8b93-7f64c3ffb01e service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:14.023859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c4f4-72a7-4128-8b93-7f64c3ffb01e service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:14.024133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c4f4-72a7-4128-8b93-7f64c3ffb01e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:14.033567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100c4f4-72a7-4128-8b93-7f64c3ffb01e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:14.035219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100c4f4-72a7-4128-8b93-7f64c3ffb01e service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:14.047067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 763/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:14.892351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4eaa5-0760-4e54-90d6-3cc6af75d62a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:14.892967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4eaa5-0760-4e54-90d6-3cc6af75d62a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:14.893060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4eaa5-0760-4e54-90d6-3cc6af75d62a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:14.897027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 08:44:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:44:14.902655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770da1-06ec-4d8b-804e-9b6ee033c6a2 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:14.903190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770da1-06ec-4d8b-804e-9b6ee033c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:14.903302 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770da1-06ec-4d8b-804e-9b6ee033c6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:14.922753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-85770da1-06ec-4d8b-804e-9b6ee033c6a2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:14.923976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-85770da1-06ec-4d8b-804e-9b6ee033c6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:14.932024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 08:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:15.089133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4eaa5-0760-4e54-90d6-3cc6af75d62a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:15.104030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4eaa5-0760-4e54-90d6-3cc6af75d62a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:15.109552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec6f1-94b7-4eba-ad84-e1a02843ed8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:15.110230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec6f1-94b7-4eba-ad84-e1a02843ed8f service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:15.110519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec6f1-94b7-4eba-ad84-e1a02843ed8f service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:15.110798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec6f1-94b7-4eba-ad84-e1a02843ed8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:15.119265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ec6f1-94b7-4eba-ad84-e1a02843ed8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:15.120853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ec6f1-94b7-4eba-ad84-e1a02843ed8f service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:15.131286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 763/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:19.075900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793129-e8e8-42ec-a445-c7ac9ebc77b8 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:19.083093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793129-e8e8-42ec-a445-c7ac9ebc77b8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:19.083093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793129-e8e8-42ec-a445-c7ac9ebc77b8 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:19.083093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:44:19.083656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad75b0e-6322-4f43-84c0-888f4ba977ad None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:19.084099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad75b0e-6322-4f43-84c0-888f4ba977ad None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:19.084211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad75b0e-6322-4f43-84c0-888f4ba977ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:19.102780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fad75b0e-6322-4f43-84c0-888f4ba977ad None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:19.104009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fad75b0e-6322-4f43-84c0-888f4ba977ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:19.112725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:19.151576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b793129-e8e8-42ec-a445-c7ac9ebc77b8 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:19.153245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4b793129-e8e8-42ec-a445-c7ac9ebc77b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:19.183152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:44:19.213433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b793129-e8e8-42ec-a445-c7ac9ebc77b8 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:19.217470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a25309-ead7-4fde-b187-9a3fbb912900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:19.218769 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25309-ead7-4fde-b187-9a3fbb912900 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:19.219247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25309-ead7-4fde-b187-9a3fbb912900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:19.219567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25309-ead7-4fde-b187-9a3fbb912900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:19.229374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a25309-ead7-4fde-b187-9a3fbb912900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:19.230872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a25309-ead7-4fde-b187-9a3fbb912900 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:19.241854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 766/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:21.302355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22dc17-20ca-4a0d-860f-a13ecab3a2b3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:21.302943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22dc17-20ca-4a0d-860f-a13ecab3a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:21.302943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22dc17-20ca-4a0d-860f-a13ecab3a2b3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:21.304282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:44:21.309484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0003b-8aa4-4e60-8020-54f96e6eccc1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:21.309952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0003b-8aa4-4e60-8020-54f96e6eccc1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:21.310053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0003b-8aa4-4e60-8020-54f96e6eccc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:21.329119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3af0003b-8aa4-4e60-8020-54f96e6eccc1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:21.330614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3af0003b-8aa4-4e60-8020-54f96e6eccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:21.338692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:21.376915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22dc17-20ca-4a0d-860f-a13ecab3a2b3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:21.378683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fa22dc17-20ca-4a0d-860f-a13ecab3a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:21.392151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22dc17-20ca-4a0d-860f-a13ecab3a2b3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:21.396021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e2e3d-8283-4624-8038-eed185448ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:21.396661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2e3d-8283-4624-8038-eed185448ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:21.396946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2e3d-8283-4624-8038-eed185448ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:21.397225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2e3d-8283-4624-8038-eed185448ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:21.406560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2e3d-8283-4624-8038-eed185448ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:21.407995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2e3d-8283-4624-8038-eed185448ce5 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:21.417651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 766/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:24.977647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a1c9-fa1e-4c0c-a44b-fd4e73d3d493 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:24.978237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a1c9-fa1e-4c0c-a44b-fd4e73d3d493 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:24.978237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a1c9-fa1e-4c0c-a44b-fd4e73d3d493 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:24.979663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:44:24.985672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42fe59-b5db-493d-8543-e1b8ff057875 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:24.986122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42fe59-b5db-493d-8543-e1b8ff057875 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:24.986289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42fe59-b5db-493d-8543-e1b8ff057875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:25.004796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-df42fe59-b5db-493d-8543-e1b8ff057875 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:25.006083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-df42fe59-b5db-493d-8543-e1b8ff057875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:25.014166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:25.318700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7a1c9-fa1e-4c0c-a44b-fd4e73d3d493 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:25.320462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1cc7a1c9-fa1e-4c0c-a44b-fd4e73d3d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:25.380276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7a1c9-fa1e-4c0c-a44b-fd4e73d3d493 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:25.383859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb28310-6e59-4536-b486-2e81e757b922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:25.384498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb28310-6e59-4536-b486-2e81e757b922 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:25.384782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb28310-6e59-4536-b486-2e81e757b922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:25.385059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb28310-6e59-4536-b486-2e81e757b922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:25.394412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb28310-6e59-4536-b486-2e81e757b922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:25.395853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb28310-6e59-4536-b486-2e81e757b922 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:25.405739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 769/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:44:27.431418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38bb0-223f-4e45-b8fa-a6ff6567aec8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:27.431997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38bb0-223f-4e45-b8fa-a6ff6567aec8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:27.431997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38bb0-223f-4e45-b8fa-a6ff6567aec8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:27.433323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 08:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:44:27.439406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429b50-64d9-443f-82a1-b046d3869377 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:27.439926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429b50-64d9-443f-82a1-b046d3869377 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:27.440042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429b50-64d9-443f-82a1-b046d3869377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:27.458514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2e429b50-64d9-443f-82a1-b046d3869377 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:44:27.459724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2e429b50-64d9-443f-82a1-b046d3869377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:27.467634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:44:27.775032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef38bb0-223f-4e45-b8fa-a6ff6567aec8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:44:27.776698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-aef38bb0-223f-4e45-b8fa-a6ff6567aec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:44:27.784806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=77 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:44:27.790207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef38bb0-223f-4e45-b8fa-a6ff6567aec8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:44:27.793706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecfd88-57ce-488d-9dff-b0f8cad1a176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:44:27.794343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecfd88-57ce-488d-9dff-b0f8cad1a176 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:44:27.794626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecfd88-57ce-488d-9dff-b0f8cad1a176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:44:27.794903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecfd88-57ce-488d-9dff-b0f8cad1a176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:44:27.804881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecfd88-57ce-488d-9dff-b0f8cad1a176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:44:27.806386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecfd88-57ce-488d-9dff-b0f8cad1a176 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:44:27.816402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 769/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:44:37.453331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=47 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:44:37.817425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:06.054616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a92b7-8323-45ea-98d0-70022d1d20ad None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.056512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a92b7-8323-45ea-98d0-70022d1d20ad None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.057375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a92b7-8323-45ea-98d0-70022d1d20ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.098590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-901a92b7-8323-45ea-98d0-70022d1d20ad None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:06.101289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-901a92b7-8323-45ea-98d0-70022d1d20ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:06.124919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 771/1540] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:06.143802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac932-f815-4d29-a5e1-66874f05c642 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.152501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac932-f815-4d29-a5e1-66874f05c642 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.152501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac932-f815-4d29-a5e1-66874f05c642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.197987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0bfac932-f815-4d29-a5e1-66874f05c642 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:06.200722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0bfac932-f815-4d29-a5e1-66874f05c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:06.229982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 770/1541] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:46:06.239026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a92b7-8323-45ea-98d0-70022d1d20ad None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:06.262779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a92b7-8323-45ea-98d0-70022d1d20ad None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:06.276785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:06.279132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.279725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.280224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.281636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:06.282212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:06.285303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:06.312190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 772/1542] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:06.320862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac932-f815-4d29-a5e1-66874f05c642 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:06.344400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac932-f815-4d29-a5e1-66874f05c642 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:06.356835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:06.357921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.358428 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.358925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.360321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:06.364546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:06.530639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 771/1543] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:06 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:06.536044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:06.564613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ae0ad-d4fe-486e-97dc-bf0b09316188 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:06.681863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:06.682568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.682861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.683145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.683896 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:06.686713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:06.782552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 773/1544] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:06 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:06.787730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:06.801755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6b443-31b8-4a60-9ec5-165c218e25cb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:06.812479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:06.813223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.813517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.813834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.814690 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:06.816621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:06.833602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 772/1545] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:06.838253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:06.850431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba11ed-848a-47e3-bb69-ec083dd9aaf8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:06.855939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24ce2e-6977-40bf-b376-35fc5656fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:06.857128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24ce2e-6977-40bf-b376-35fc5656fbbc admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.857538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24ce2e-6977-40bf-b376-35fc5656fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.857925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24ce2e-6977-40bf-b376-35fc5656fbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.858707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24ce2e-6977-40bf-b376-35fc5656fbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:06.860406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24ce2e-6977-40bf-b376-35fc5656fbbc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:06.877409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 774/1546] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:06.882661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:06.896201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461699-c263-44ed-98b9-b39a1877ba0b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:06.901594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de84ea-5e93-461f-984c-31166e1dd172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:06.902599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de84ea-5e93-461f-984c-31166e1dd172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:06.903491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de84ea-5e93-461f-984c-31166e1dd172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:06.903821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de84ea-5e93-461f-984c-31166e1dd172 admin admin] PATH_INFO: `/v3/projects/de15ad4e78084e4983036723d2bc61fa/users/cdcf60e64d654b1eb4154a007ccfcba8/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:06.927512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de84ea-5e93-461f-984c-31166e1dd172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de15ad4e78084e4983036723d2bc61fa, user_id=cdcf60e64d654b1eb4154a007ccfcba8, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:06.930509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de84ea-5e93-461f-984c-31166e1dd172 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.043257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 773/1547] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:06 2022] PUT /identity/v3/projects/de15ad4e78084e4983036723d2bc61fa/users/cdcf60e64d654b1eb4154a007ccfcba8/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:46:07.050931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b8c33-0508-4d47-b154-3abefbeef052 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.051475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b8c33-0508-4d47-b154-3abefbeef052 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.051769 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b8c33-0508-4d47-b154-3abefbeef052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.069666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafca13-9c28-46de-a08e-17b3e2cb996a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.069666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafca13-9c28-46de-a08e-17b3e2cb996a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.069666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafca13-9c28-46de-a08e-17b3e2cb996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.091415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1b7b8c33-0508-4d47-b154-3abefbeef052 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.092708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1b7b8c33-0508-4d47-b154-3abefbeef052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.126691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ccafca13-9c28-46de-a08e-17b3e2cb996a None None] MFA Rules not processed for user `cdcf60e64d654b1eb4154a007ccfcba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.128797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ccafca13-9c28-46de-a08e-17b3e2cb996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.253383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 775/1548] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.260316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42571d-0f18-408a-9480-0b82ad413b8f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.260665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42571d-0f18-408a-9480-0b82ad413b8f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.260956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42571d-0f18-408a-9480-0b82ad413b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.266871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 774/1549] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.267453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b8d0d-0bad-4fd6-9184-7fc910de856e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.267664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b8d0d-0bad-4fd6-9184-7fc910de856e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.268306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b8d0d-0bad-4fd6-9184-7fc910de856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.306492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bf42571d-0f18-408a-9480-0b82ad413b8f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.310127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bf42571d-0f18-408a-9480-0b82ad413b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.314827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-082b8d0d-0bad-4fd6-9184-7fc910de856e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.316642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-082b8d0d-0bad-4fd6-9184-7fc910de856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.332499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 776/1550] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.333898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4589b3-407b-40d3-8038-24794a431d69 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.335490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4589b3-407b-40d3-8038-24794a431d69 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.342287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 775/1551] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.342287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f409c2-1926-4128-b541-fb951ebe8a6c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.342287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f409c2-1926-4128-b541-fb951ebe8a6c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.342287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f409c2-1926-4128-b541-fb951ebe8a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.343798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4589b3-407b-40d3-8038-24794a431d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.381982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-66f409c2-1926-4128-b541-fb951ebe8a6c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.383594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-5c4589b3-407b-40d3-8038-24794a431d69 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.388421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-66f409c2-1926-4128-b541-fb951ebe8a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.390737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5c4589b3-407b-40d3-8038-24794a431d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.415748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 776/1552] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.416261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 777/1553] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.418535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f409c2-1926-4128-b541-fb951ebe8a6c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.419720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197c95-e39c-4e4f-8129-ca1838f5eb8a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.421495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197c95-e39c-4e4f-8129-ca1838f5eb8a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.421943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197c95-e39c-4e4f-8129-ca1838f5eb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.459952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b4197c95-e39c-4e4f-8129-ca1838f5eb8a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.462024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b4197c95-e39c-4e4f-8129-ca1838f5eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.473383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 778/1554] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.479394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7bfe-b64b-41e2-8277-cecbeec8c292 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.479928 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7bfe-b64b-41e2-8277-cecbeec8c292 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.480390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7bfe-b64b-41e2-8277-cecbeec8c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.504266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d21e7bfe-b64b-41e2-8277-cecbeec8c292 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.505913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d21e7bfe-b64b-41e2-8277-cecbeec8c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.506408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f409c2-1926-4128-b541-fb951ebe8a6c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.511340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0827d-7eb5-4f64-95b9-44509bdb6131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.512201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0827d-7eb5-4f64-95b9-44509bdb6131 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.513149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0827d-7eb5-4f64-95b9-44509bdb6131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.513783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0827d-7eb5-4f64-95b9-44509bdb6131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.524847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0827d-7eb5-4f64-95b9-44509bdb6131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.526476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 779/1555] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.526669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0827d-7eb5-4f64-95b9-44509bdb6131 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.527778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e7bfe-b64b-41e2-8277-cecbeec8c292 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.539809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e7bfe-b64b-41e2-8277-cecbeec8c292 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.543908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 777/1556] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:07.545927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cde1e-7d01-46e3-a5a7-f9460030ad79 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.546336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cde1e-7d01-46e3-a5a7-f9460030ad79 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.546732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cde1e-7d01-46e3-a5a7-f9460030ad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.567277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.569067 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.569961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d08cde1e-7d01-46e3-a5a7-f9460030ad79 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.570148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.570577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.571684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d08cde1e-7d01-46e3-a5a7-f9460030ad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.574068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:07.574632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.580859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.582160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 778/1557] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.583941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aac60f-b55b-4955-a035-b7de8ff2befb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.584323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aac60f-b55b-4955-a035-b7de8ff2befb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.584698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aac60f-b55b-4955-a035-b7de8ff2befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.602205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 780/1558] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:07.603751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.617113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed952-15b2-445a-b78c-86e2ed01a504 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.625117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.626134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.626567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.627013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.628453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:07.628958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.629813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-62aac60f-b55b-4955-a035-b7de8ff2befb None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.631168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-62aac60f-b55b-4955-a035-b7de8ff2befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.631936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.647658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 779/1559] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.647658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aac60f-b55b-4955-a035-b7de8ff2befb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.658666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:07.667256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aac60f-b55b-4955-a035-b7de8ff2befb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.671835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 781/1560] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:07.679070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.679215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.679215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.679215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.685108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.685108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:07.685108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.685108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:46:07.685108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 18 08:46:07.685108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: Jul 18 08:46:07.686699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.694354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef8d9b-845e-4346-b557-7fc149b575fc admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.701788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e89de-5339-475e-8b79-c2ceb2db3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.702711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e89de-5339-475e-8b79-c2ceb2db3454 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.703098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e89de-5339-475e-8b79-c2ceb2db3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.703553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e89de-5339-475e-8b79-c2ceb2db3454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.704706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e89de-5339-475e-8b79-c2ceb2db3454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:07.705397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e89de-5339-475e-8b79-c2ceb2db3454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.707493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e89de-5339-475e-8b79-c2ceb2db3454 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.709651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:07.728749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 780/1561] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:07.728749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.733441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60cb71-76ad-4ff5-b6f0-a40fd4d96dac admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.733964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 782/1562] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:07.736181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad193344-ad41-4f76-9324-786ff0b40d38 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.736740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad193344-ad41-4f76-9324-786ff0b40d38 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.738236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad193344-ad41-4f76-9324-786ff0b40d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.746545 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.750000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.751348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.751944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.754269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.757032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.784377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ad193344-ad41-4f76-9324-786ff0b40d38 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.787828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ad193344-ad41-4f76-9324-786ff0b40d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.805762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 783/1563] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.805762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb771f-f907-44c7-977e-a16c02f75cc5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.805762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb771f-f907-44c7-977e-a16c02f75cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.805762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb771f-f907-44c7-977e-a16c02f75cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.837515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0dfb771f-f907-44c7-977e-a16c02f75cc5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:07.839516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0dfb771f-f907-44c7-977e-a16c02f75cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:07.854350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 784/1564] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:07.855621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb771f-f907-44c7-977e-a16c02f75cc5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.874643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb771f-f907-44c7-977e-a16c02f75cc5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.885749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 781/1565] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:07.885749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:07.885959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.885959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.886170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.886603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.888937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.890651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:46:07.890651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:46:07.890651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:46:07.892993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:07.958711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b798-c23f-4051-884e-ffd60704192c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:07.963809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d05c3-426b-4a99-8308-8362dfaac222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:07.964530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d05c3-426b-4a99-8308-8362dfaac222 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:07.964810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d05c3-426b-4a99-8308-8362dfaac222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:07.965080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d05c3-426b-4a99-8308-8362dfaac222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:07.966438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d05c3-426b-4a99-8308-8362dfaac222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:07.968586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d05c3-426b-4a99-8308-8362dfaac222 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.024855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 785/1566] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.024855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.085634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 782/1567] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:07 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.091886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc97f9-b0a4-4d54-9a3a-6844fbb341f0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.092281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc97f9-b0a4-4d54-9a3a-6844fbb341f0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.093020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc97f9-b0a4-4d54-9a3a-6844fbb341f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.099449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba84bb-358d-4b3b-bd84-ef62e26174a2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.117248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f0fc97f9-b0a4-4d54-9a3a-6844fbb341f0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:08.118864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f0fc97f9-b0a4-4d54-9a3a-6844fbb341f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:08.199485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.201319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.201833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.202307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.203624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.207292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.213161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 783/1568] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:08.214784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc97f9-b0a4-4d54-9a3a-6844fbb341f0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.234766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc97f9-b0a4-4d54-9a3a-6844fbb341f0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.242414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5a648-f39d-4551-a06e-ac62c75e4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.243483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a648-f39d-4551-a06e-ac62c75e4988 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.243888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a648-f39d-4551-a06e-ac62c75e4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.244282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a648-f39d-4551-a06e-ac62c75e4988 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.245390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5a648-f39d-4551-a06e-ac62c75e4988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:08.245911 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5a648-f39d-4551-a06e-ac62c75e4988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.250088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5a648-f39d-4551-a06e-ac62c75e4988 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.262019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 784/1569] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:08.264119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca60e9-8711-47ec-9a24-f96032366845 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.264410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca60e9-8711-47ec-9a24-f96032366845 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.264685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca60e9-8711-47ec-9a24-f96032366845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.284728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-95ca60e9-8711-47ec-9a24-f96032366845 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:08.285976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-95ca60e9-8711-47ec-9a24-f96032366845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:08.294217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 785/1570] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:08.295092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca60e9-8711-47ec-9a24-f96032366845 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.305104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca60e9-8711-47ec-9a24-f96032366845 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.310800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.313425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.313425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.313425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.313425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.313969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:46:08.313969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 18 08:46:08.313969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: Jul 18 08:46:08.315269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.369071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 786/1571] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/projects => generated 377 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.369886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.396569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 786/1572] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.407518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.409456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6c8c2-bb57-4157-af96-f20af8018c90 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.424386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:08.449345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:08.465980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf807-9004-4801-99b5-94034cd1bc61 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.471625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90b0fb-6d85-4d7d-87c5-21019a59eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.474151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90b0fb-6d85-4d7d-87c5-21019a59eac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.474151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90b0fb-6d85-4d7d-87c5-21019a59eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.474151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90b0fb-6d85-4d7d-87c5-21019a59eac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.474151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90b0fb-6d85-4d7d-87c5-21019a59eac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.476026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90b0fb-6d85-4d7d-87c5-21019a59eac6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.495660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.496511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.497851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.497851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.503033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.503033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.644555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 787/1573] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.647224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dc89-8182-48b2-b369-200390a68918 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.647822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dc89-8182-48b2-b369-200390a68918 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.648250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dc89-8182-48b2-b369-200390a68918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.653717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 787/1574] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.655321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.675486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554c14e-6e72-47cd-8475-20239aaf72e4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.685950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.685950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.685950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.685950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.686624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.688319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-22b4dc89-8182-48b2-b369-200390a68918 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:08.688710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.690492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-22b4dc89-8182-48b2-b369-200390a68918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:08.706006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 788/1575] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:08.707476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4dc89-8182-48b2-b369-200390a68918 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.725802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4dc89-8182-48b2-b369-200390a68918 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.738073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.739259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.739810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.740315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.741877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:08.742497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.745559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.783092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 789/1576] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:08.783092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.794232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ee823-5f57-413a-b17b-8f6a51192516 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.804052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.806133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.806549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.806964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.808242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.812753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.818059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 788/1577] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.819286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.906473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429868d-9a63-4fb9-bfde-6efebabe6820 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.911802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.912615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.912909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.913215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.914200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.915890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.929807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 789/1578] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:08.930896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.946038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 790/1579] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:08.948118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:08.958637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c196-f2d8-4a4c-b67d-e7e1eec0200f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.968097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.968825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf13474-4457-4f3c-9f72-5e46c7b9bec8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:08.969756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.970318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.970886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.972400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.975593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:08.977288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:08.978486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:08.979021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:08.979584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:08.980667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:08.983684 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.001244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 791/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.001558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 790/1581] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.001750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.001933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.013872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662527-5b3d-40c8-bd32-83c1c70e5d0f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.018972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada36e8c-cae8-4f57-b646-925651e8fa27 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.019365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.020216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.020516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.020876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.021984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:09.022430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.024417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.027448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.029526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.029897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.030263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.031593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.035604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.041391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 792/1582] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:09.046008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.063970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbdb5b-750f-499a-955a-8c2f9fb3dfe9 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.071717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.073326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.074045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.074530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.075892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.079995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.159581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 791/1583] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:08 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:09.159917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.194210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 793/1584] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:09 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:09.194210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.209965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a2572-017c-4e5b-868c-79919d067d99 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.228301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:09.246038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c5737-b104-470c-a26c-98faac92c66e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.252391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.253071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.253432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.253604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.254447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.256178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.267638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 792/1585] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.268546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.283723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc275a-baf3-4442-9400-d82ae2233652 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.288732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.289797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.289797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.290094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.290724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.292974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.310985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 793/1586] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.310985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.320160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c010c-b4be-4b81-a689-ec467b647577 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.325528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.326861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.327061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.327201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.327355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.327495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.327627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.327948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.328339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.329319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.330030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.332518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.344898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 794/1587] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.346046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 794/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.346758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.347059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.361602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271248f-3aad-4d46-9150-170e4eff7ce3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.363397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a571c-43e8-4c01-a2f4-c3e5e3703488 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.368668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.370340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.370713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.370906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.371699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.372360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.373512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.373733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.374166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.375304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.377062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.379113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.506072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 795/1589] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:09 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:09.507004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.518140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b2f4-b993-4b24-90e5-01c036e6e93e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.522995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.523700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.523976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.524258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.525015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.526732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.541291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 795/1590] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:09 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:09.541291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.552865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 796/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.554344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.566203 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251492-5820-45a5-aaaa-e3b54b3448ae admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.616010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:09.629476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b9f64-0405-4cb4-8f8c-7010a0a74073 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.635043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.635979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.636245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.636518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] PATH_INFO: `/v3/projects/d3e8fbe275464acfbf5c23b8aac62336/users/438c2ee579334d998e56d4d1e7278835/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.655021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e8fbe275464acfbf5c23b8aac62336, user_id=438c2ee579334d998e56d4d1e7278835, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.657835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.667423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.668345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.668764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.669045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] PATH_INFO: `/v3/projects/1b45146dbba842499dffbcd29ef8a86a/users/af0797b9505b49bb8ea04e7114ea71b3/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.686471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b45146dbba842499dffbcd29ef8a86a, user_id=af0797b9505b49bb8ea04e7114ea71b3, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.687779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:46:09.687779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:46:09.687779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:46:09.690166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.763595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 796/1592] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:09 2022] PUT /identity/v3/projects/d3e8fbe275464acfbf5c23b8aac62336/users/438c2ee579334d998e56d4d1e7278835/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:09.764820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.799342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 797/1593] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:09 2022] PUT /identity/v3/projects/1b45146dbba842499dffbcd29ef8a86a/users/af0797b9505b49bb8ea04e7114ea71b3/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:09.810939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.868795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576f76-6cf6-49ff-ae50-3a91fb1be76b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.904633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:09.915414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875499dd-fce7-4fb7-a0eb-b7085ce78d2e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.931630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.931630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.931630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.931630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.932338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.932338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.950423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 798/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:09.953646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:09.957762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.958824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.959156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.959484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] PATH_INFO: `/v3/projects/45145b9ccbe447b4964a521eb379c381/users/696093856c864253a460e4b9362ce7cc/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.974025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73486241-96f0-48f6-b050-47d8ec72b63f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:09.979726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45145b9ccbe447b4964a521eb379c381, user_id=696093856c864253a460e4b9362ce7cc, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.983231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:09.983668 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:09.984380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:09.984867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:09.985362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:09.986849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:09.990121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.011833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 799/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:10.013468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.032115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f622d33-4957-46d7-9e5b-dff6c5aba385 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.040286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a73d0d-7384-4491-a83d-ea5ab247a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.041394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73d0d-7384-4491-a83d-ea5ab247a809 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.041911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73d0d-7384-4491-a83d-ea5ab247a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.042394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73d0d-7384-4491-a83d-ea5ab247a809 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.044813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a73d0d-7384-4491-a83d-ea5ab247a809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.048170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a73d0d-7384-4491-a83d-ea5ab247a809 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.094079 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 797/1596] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:09 2022] PUT /identity/v3/projects/45145b9ccbe447b4964a521eb379c381/users/696093856c864253a460e4b9362ce7cc/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:10.094956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.173123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543fcb8-f73c-4ff0-9e1b-e9146c4bb83e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.178717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28efe6-312b-4f65-883c-e7c9a4ba587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.179476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28efe6-312b-4f65-883c-e7c9a4ba587d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.179931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28efe6-312b-4f65-883c-e7c9a4ba587d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.180403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28efe6-312b-4f65-883c-e7c9a4ba587d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.181238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28efe6-312b-4f65-883c-e7c9a4ba587d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.187745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28efe6-312b-4f65-883c-e7c9a4ba587d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.193420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 800/1597] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:10 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:10.195301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade1a2c-55d2-4965-b615-e982284c8f5c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.196328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade1a2c-55d2-4965-b615-e982284c8f5c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.196328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade1a2c-55d2-4965-b615-e982284c8f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.204444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 798/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:10.206427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ce363-49ad-4949-867a-a43b3962ddfb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.206931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ce363-49ad-4949-867a-a43b3962ddfb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.207413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ce363-49ad-4949-867a-a43b3962ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.241190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2ade1a2c-55d2-4965-b615-e982284c8f5c None None] MFA Rules not processed for user `438c2ee579334d998e56d4d1e7278835`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:10.243189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2ade1a2c-55d2-4965-b615-e982284c8f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:10.252223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-790ce363-49ad-4949-867a-a43b3962ddfb None None] MFA Rules not processed for user `af0797b9505b49bb8ea04e7114ea71b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:10.253998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-790ce363-49ad-4949-867a-a43b3962ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:10.344807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 801/1599] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:10.346035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade1a2c-55d2-4965-b615-e982284c8f5c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.357555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 799/1600] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:10.360041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ce363-49ad-4949-867a-a43b3962ddfb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.374519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade1a2c-55d2-4965-b615-e982284c8f5c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.386250 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f91624-0716-44ba-b15c-9ee3c64728bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.388801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f91624-0716-44ba-b15c-9ee3c64728bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.389268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f91624-0716-44ba-b15c-9ee3c64728bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.389757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f91624-0716-44ba-b15c-9ee3c64728bc admin admin] PATH_INFO: `/v3/projects/e301dcf7df4142eea34f8f1bd6380b8a/users/e59b9b2fcf024b05a9d751a42713f012/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.390847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ce363-49ad-4949-867a-a43b3962ddfb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.396080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:10.405505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29871e8b-aadc-40da-b1d3-2b3ecd3710b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.407958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29871e8b-aadc-40da-b1d3-2b3ecd3710b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.408620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29871e8b-aadc-40da-b1d3-2b3ecd3710b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.409233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29871e8b-aadc-40da-b1d3-2b3ecd3710b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.410920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29871e8b-aadc-40da-b1d3-2b3ecd3710b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.414285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29871e8b-aadc-40da-b1d3-2b3ecd3710b6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.426197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f91624-0716-44ba-b15c-9ee3c64728bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e301dcf7df4142eea34f8f1bd6380b8a, user_id=e59b9b2fcf024b05a9d751a42713f012, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.429668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f91624-0716-44ba-b15c-9ee3c64728bc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.437717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 800/1601] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:10.438910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da9c24-a463-425c-a48f-d411f9443dfc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.439428 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da9c24-a463-425c-a48f-d411f9443dfc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.440146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da9c24-a463-425c-a48f-d411f9443dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.471587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-64da9c24-a463-425c-a48f-d411f9443dfc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:10.473780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-64da9c24-a463-425c-a48f-d411f9443dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:10.487459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 801/1602] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:10.489049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da9c24-a463-425c-a48f-d411f9443dfc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.507486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da9c24-a463-425c-a48f-d411f9443dfc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.516384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.517578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.518135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.518656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.520167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.523601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.544136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 802/1603] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:10.545727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.565024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9c45-bf3d-4710-9c9a-38b31d1cf9c3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.568392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 802/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:10 2022] PUT /identity/v3/projects/e301dcf7df4142eea34f8f1bd6380b8a/users/e59b9b2fcf024b05a9d751a42713f012/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:10.570386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40c07-f2f3-464c-a1c9-4258e8d30954 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.570904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40c07-f2f3-464c-a1c9-4258e8d30954 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.571485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40c07-f2f3-464c-a1c9-4258e8d30954 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.573347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 803/1605] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 08:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:10.574119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:10.580065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922236a-aabe-48c1-8650-8c6f1fc45a9c None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.580065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922236a-aabe-48c1-8650-8c6f1fc45a9c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.580065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922236a-aabe-48c1-8650-8c6f1fc45a9c None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.580065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 804/1606] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 08:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:10.580065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922236a-aabe-48c1-8650-8c6f1fc45a9c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.662548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922236a-aabe-48c1-8650-8c6f1fc45a9c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.668244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.669806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.670092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.670367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] PATH_INFO: `/v3/projects/02cbde0626274aa7ae99d6f994810786/users/c048ce9cc5484139a3c5f87b4e204809/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.673542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.674829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.675306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.675805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] PATH_INFO: `/v3/projects/f71d6e1a31d74de59fd417a91c7b48d9/users/e020ebafb58d4f089b8bdc6c7e4f02f0/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.688807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cbde0626274aa7ae99d6f994810786, user_id=c048ce9cc5484139a3c5f87b4e204809, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.691714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.705117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71d6e1a31d74de59fd417a91c7b48d9, user_id=e020ebafb58d4f089b8bdc6c7e4f02f0, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.710939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.779544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 805/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:10 2022] PUT /identity/v3/projects/02cbde0626274aa7ae99d6f994810786/users/c048ce9cc5484139a3c5f87b4e204809/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:10.781141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.816800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 803/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:10 2022] PUT /identity/v3/projects/f71d6e1a31d74de59fd417a91c7b48d9/users/e020ebafb58d4f089b8bdc6c7e4f02f0/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:10.818224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:10.857186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d566e-14fb-4da5-997b-deaa9a980403 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.918324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513f31-40e9-43cc-88f7-e42888b4a9c4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:10.925657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8851d6-bc70-400e-ac04-c7629673efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.926475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8851d6-bc70-400e-ac04-c7629673efd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.926885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8851d6-bc70-400e-ac04-c7629673efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.927276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8851d6-bc70-400e-ac04-c7629673efd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.928164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8851d6-bc70-400e-ac04-c7629673efd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.930532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8851d6-bc70-400e-ac04-c7629673efd6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.939622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f41db-1f1b-41ab-88e6-ad2331b9dbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:10.940573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f41db-1f1b-41ab-88e6-ad2331b9dbae service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.941047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f41db-1f1b-41ab-88e6-ad2331b9dbae service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.941446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f41db-1f1b-41ab-88e6-ad2331b9dbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.953234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 804/1609] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:10.955358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6732f-7c3b-407a-9bbf-d4e5abc820ce None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.955844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6732f-7c3b-407a-9bbf-d4e5abc820ce None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.956275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6732f-7c3b-407a-9bbf-d4e5abc820ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.960511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f41db-1f1b-41ab-88e6-ad2331b9dbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:10.963577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f41db-1f1b-41ab-88e6-ad2331b9dbae service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:10.980572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9ea6732f-7c3b-407a-9bbf-d4e5abc820ce None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:10.982801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9ea6732f-7c3b-407a-9bbf-d4e5abc820ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:10.984144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 806/1610] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:10.988879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83769-1ea9-43da-b436-5f6a01d0e290 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.989934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83769-1ea9-43da-b436-5f6a01d0e290 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.990413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83769-1ea9-43da-b436-5f6a01d0e290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:10.995389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 805/1611] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:10.998320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afe614-01ae-456f-9862-95d7e339f09b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:10.998702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afe614-01ae-456f-9862-95d7e339f09b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:10.999169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afe614-01ae-456f-9862-95d7e339f09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.065426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e4afe614-01ae-456f-9862-95d7e339f09b None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:11.067057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e4afe614-01ae-456f-9862-95d7e339f09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:11.071337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-82d83769-1ea9-43da-b436-5f6a01d0e290 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:11.072589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-82d83769-1ea9-43da-b436-5f6a01d0e290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:11.086217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:11.148256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:11.168117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 806/1612] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:11.170912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619dbdf-08d2-49ed-8a60-644eb53de83b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.171619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619dbdf-08d2-49ed-8a60-644eb53de83b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.172189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619dbdf-08d2-49ed-8a60-644eb53de83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.196904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 807/1613] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:11.199349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596cb03-6c49-4d19-8c73-e758b2d6e611 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.201256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596cb03-6c49-4d19-8c73-e758b2d6e611 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.232627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596cb03-6c49-4d19-8c73-e758b2d6e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.232917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1619dbdf-08d2-49ed-8a60-644eb53de83b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:11.232917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1619dbdf-08d2-49ed-8a60-644eb53de83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:11.232917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 807/1614] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:11.232917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619dbdf-08d2-49ed-8a60-644eb53de83b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:11.245726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619dbdf-08d2-49ed-8a60-644eb53de83b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:11.256201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a596cb03-6c49-4d19-8c73-e758b2d6e611 None None] MFA Rules not processed for user `e020ebafb58d4f089b8bdc6c7e4f02f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:11.256774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:11.257482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a596cb03-6c49-4d19-8c73-e758b2d6e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:11.258798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.259382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.259969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] PATH_INFO: `/v3/projects/5bd95f703d4a4e36a4dfcd8f1257db53/users/a5bbefa9f11b462baa345257b9f3709d/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.295329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd95f703d4a4e36a4dfcd8f1257db53, user_id=a5bbefa9f11b462baa345257b9f3709d, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:11.302878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:11.360507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 808/1615] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:11.362023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596cb03-6c49-4d19-8c73-e758b2d6e611 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:11.377205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596cb03-6c49-4d19-8c73-e758b2d6e611 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:11.381461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:11.382203 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.382482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.382756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.394801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:11.396276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:11.408753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 809/1616] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:11.409747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:11.424032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 808/1617] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:11 2022] PUT /identity/v3/projects/5bd95f703d4a4e36a4dfcd8f1257db53/users/a5bbefa9f11b462baa345257b9f3709d/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:11.424032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:11.439292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfeee-fbb0-4525-bb75-25b2095cf557 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:11.537640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:11.537970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.538105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.538389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.575484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:11.581403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071e79-02ed-4cf7-ab7b-758d843d7309 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:11.588302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:11.589323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.589836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.591347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.669068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:11.672649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:11.692428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 810/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:11.693996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:11.734431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:11.740439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:11.780004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 809/1619] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:11.783684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:11.873929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9008cc-8551-4bb7-9340-32231775f202 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:11.887938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8feb72-dc90-46d5-9bb2-e47fc6d174ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:11.892743 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8feb72-dc90-46d5-9bb2-e47fc6d174ad service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.893247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8feb72-dc90-46d5-9bb2-e47fc6d174ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.893812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8feb72-dc90-46d5-9bb2-e47fc6d174ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.946997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ef0d0-58a6-41ec-82d7-53607d10da06 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:11.958584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:11.961159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:11.962222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:11.963432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:11.966724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:11.971378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:11.995856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:12.055374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8feb72-dc90-46d5-9bb2-e47fc6d174ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:12.058196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8feb72-dc90-46d5-9bb2-e47fc6d174ad service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:12.081159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 811/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:12.085337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1338c-dac0-42af-8c1a-7394351f027e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.085337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1338c-dac0-42af-8c1a-7394351f027e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.085799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1338c-dac0-42af-8c1a-7394351f027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.126422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f8f1338c-dac0-42af-8c1a-7394351f027e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:12.128530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f8f1338c-dac0-42af-8c1a-7394351f027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:12.147028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 812/1621] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:12.214424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1338c-dac0-42af-8c1a-7394351f027e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:12.235031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 810/1622] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:11 2022] POST /identity/v3/projects => generated 385 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:12.243858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:12.275661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1338c-dac0-42af-8c1a-7394351f027e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:12.409408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7623c-0266-45f1-861f-0e6617489ebc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:12.419602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb56bc-caf6-4306-ad40-42a9b72e7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:12.420903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb56bc-caf6-4306-ad40-42a9b72e7d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.421453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb56bc-caf6-4306-ad40-42a9b72e7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.422018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb56bc-caf6-4306-ad40-42a9b72e7d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.423235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb56bc-caf6-4306-ad40-42a9b72e7d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:12.426529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb56bc-caf6-4306-ad40-42a9b72e7d4d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:12.431805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938fc5-7029-41de-988e-a8e823d82c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:12.432495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938fc5-7029-41de-988e-a8e823d82c44 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.432786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938fc5-7029-41de-988e-a8e823d82c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.433119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938fc5-7029-41de-988e-a8e823d82c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.445100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938fc5-7029-41de-988e-a8e823d82c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:12.446722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938fc5-7029-41de-988e-a8e823d82c44 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:12.459774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 813/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:12.461271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8076c-2de4-474d-9042-3ad064b31ff0 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.461571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8076c-2de4-474d-9042-3ad064b31ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.461894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8076c-2de4-474d-9042-3ad064b31ff0 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.463631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 814/1624] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jul 18 08:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:12.465269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7269a3-b686-4c00-a9aa-af9c29d8e4fe None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.466143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7269a3-b686-4c00-a9aa-af9c29d8e4fe None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.466413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7269a3-b686-4c00-a9aa-af9c29d8e4fe None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.468083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 815/1625] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jul 18 08:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:12.473716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f816e9-30b7-4bd2-8caf-8bace5b6edd8 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.474083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f816e9-30b7-4bd2-8caf-8bace5b6edd8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.474354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f816e9-30b7-4bd2-8caf-8bace5b6edd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.485325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:12.502496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-94f816e9-30b7-4bd2-8caf-8bace5b6edd8 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:12.503949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-94f816e9-30b7-4bd2-8caf-8bace5b6edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:12.562305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 811/1626] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:12 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:12.564111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8d2b-182e-47e9-987b-524b22fe8b9f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.564517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8d2b-182e-47e9-987b-524b22fe8b9f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.564921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8d2b-182e-47e9-987b-524b22fe8b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.596375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-132e8d2b-182e-47e9-987b-524b22fe8b9f None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:12.598966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-132e8d2b-182e-47e9-987b-524b22fe8b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:12.663319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 816/1627] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:46:12.664968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f816e9-30b7-4bd2-8caf-8bace5b6edd8 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:12.695900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f816e9-30b7-4bd2-8caf-8bace5b6edd8 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:12.706838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:12.708574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.709052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.709506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.711000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:12.716861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:12.736742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 812/1628] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:12.738419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8d2b-182e-47e9-987b-524b22fe8b9f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:12.745733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 817/1629] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:12.753716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:12.766205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859897b-64a9-4d5d-a3dd-7dcd71dc9760 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:12.771785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:12.773347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.773709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.774719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] PATH_INFO: `/v3/projects/d3a21a819bab464b876a1ef746e5017d/users/6621543d2b7049589c44663b005a678a/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.797009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a21a819bab464b876a1ef746e5017d, user_id=6621543d2b7049589c44663b005a678a, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:12.801870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:12.879582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8d2b-182e-47e9-987b-524b22fe8b9f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:12.892265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:12.892265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.892265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.892265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.899442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:12.901021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:12.914354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 813/1630] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:12.915069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:12.925982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9138b8-d14f-40e7-95e1-379b4e20e7c0 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:12.941544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:12.941544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:12.941544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:12.941544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:12.948020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:12.950466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:12.969408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 814/1631] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:12.992895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 818/1632] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:12 2022] PUT /identity/v3/projects/d3a21a819bab464b876a1ef746e5017d/users/6621543d2b7049589c44663b005a678a/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:12.995090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:13.001764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:13.015087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84be6f2-ddc3-436e-986d-ca0c55053e49 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:13.219037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315fd81-c841-4729-9bcc-3470f8fe66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:13.225641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315fd81-c841-4729-9bcc-3470f8fe66dc admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:13.226349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315fd81-c841-4729-9bcc-3470f8fe66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:13.226942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315fd81-c841-4729-9bcc-3470f8fe66dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:13.228581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315fd81-c841-4729-9bcc-3470f8fe66dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:13.236471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315fd81-c841-4729-9bcc-3470f8fe66dc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:13.287568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 815/1633] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:46:13.289988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:13.320610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b8a36-4aae-4110-bfbb-5eebf3cbbd86 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:13.341399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:13.345024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:13.345659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:13.346138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] PATH_INFO: `/v3/projects/d3a21a819bab464b876a1ef746e5017d/users/6621543d2b7049589c44663b005a678a/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:13.350151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a21a819bab464b876a1ef746e5017d, user_id=6621543d2b7049589c44663b005a678a, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:13.357977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:13.382584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 819/1634] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:13 2022] PUT /identity/v3/projects/d3a21a819bab464b876a1ef746e5017d/users/6621543d2b7049589c44663b005a678a/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:13.396109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f5eb-3355-458d-8f59-5a06ae411a52 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:13.396610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f5eb-3355-458d-8f59-5a06ae411a52 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:13.398937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f5eb-3355-458d-8f59-5a06ae411a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:13.502268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-aa86f5eb-3355-458d-8f59-5a06ae411a52 None None] MFA Rules not processed for user `6621543d2b7049589c44663b005a678a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:13.505718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-aa86f5eb-3355-458d-8f59-5a06ae411a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:13.697808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 816/1635] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:14.306495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:14.446089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa72f-c7b2-4530-9989-8b7eec9941fc admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:14.454734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268f48-d173-4763-9bf1-87afea33bc5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:14.456684 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268f48-d173-4763-9bf1-87afea33bc5e service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:14.457192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268f48-d173-4763-9bf1-87afea33bc5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:14.457695 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268f48-d173-4763-9bf1-87afea33bc5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:14.498277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69268f48-d173-4763-9bf1-87afea33bc5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:14.508325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69268f48-d173-4763-9bf1-87afea33bc5e service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:14.553951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 820/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:14.635163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f5eb-3355-458d-8f59-5a06ae411a52 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:14.792882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f5eb-3355-458d-8f59-5a06ae411a52 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:14.810665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:14.810665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:14.810665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:14.810665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] PATH_INFO: `/v3/users/e020ebafb58d4f089b8bdc6c7e4f02f0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:14.816805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e020ebafb58d4f089b8bdc6c7e4f02f0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:14.819752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:14.974041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:15.124320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e020ebafb58d4f089b8bdc6c7e4f02f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:15.126879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e020ebafb58d4f089b8bdc6c7e4f02f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:15.151858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e020ebafb58d4f089b8bdc6c7e4f02f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:15.162935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e020ebafb58d4f089b8bdc6c7e4f02f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:15.163815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e020ebafb58d4f089b8bdc6c7e4f02f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:15.273638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 817/1637] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:14 2022] DELETE /identity/v3/users/e020ebafb58d4f089b8bdc6c7e4f02f0 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:15.279462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:15.279912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:15.280339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:15.350163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:15.354322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:15.558416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:15.593733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 821/1638] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:46:15.604041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:15.606767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:15.711710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ec9bf-03ab-4c91-aa36-ff6f0efc6d46 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:15.718846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:15.720090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:15.720618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:15.721100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:15.741570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:15.745567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:15.771337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 818/1639] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:17.904173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:17.905722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:17.933859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ba7e-982f-4917-88ee-74b863e18212 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:17.959494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:17.960934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:17.961554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:17.961996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] PATH_INFO: `/v3/projects/f71d6e1a31d74de59fd417a91c7b48d9` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:17.968337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71d6e1a31d74de59fd417a91c7b48d9)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:18.008988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:18.353521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71d6e1a31d74de59fd417a91c7b48d9', 'request_id': 'req-0d811e8d-88d2-4c2d-bd45-2db642d86239'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:18.374817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71d6e1a31d74de59fd417a91c7b48d9', 'request_id': 'req-0d811e8d-88d2-4c2d-bd45-2db642d86239'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:18.451648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71d6e1a31d74de59fd417a91c7b48d9', 'request_id': 'req-0d811e8d-88d2-4c2d-bd45-2db642d86239'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:18.646030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] The token cache is being invalidate because project f71d6e1a31d74de59fd417a91c7b48d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:18.647079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:18.651228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:18.655502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 822/1640] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:17 2022] DELETE /identity/v3/projects/f71d6e1a31d74de59fd417a91c7b48d9 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:18.662284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:18.687381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74097c-6c82-436c-991c-7e90d0a9745e service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:18.919214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:18.920150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:18.920445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:18.920721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] PATH_INFO: `/v3/users/6621543d2b7049589c44663b005a678a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:18.926295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6621543d2b7049589c44663b005a678a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:18.928620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:19.308162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6621543d2b7049589c44663b005a678a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:19.312581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6621543d2b7049589c44663b005a678a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:19.315271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:19.381284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:19.385025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:19.418044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6621543d2b7049589c44663b005a678a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:19.458687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811e8d-88d2-4c2d-bd45-2db642d86239 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:19.472635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6621543d2b7049589c44663b005a678a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:19.476862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:19.477837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:19.478115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:19.481889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] PATH_INFO: `/v3/users/438c2ee579334d998e56d4d1e7278835` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:19.485563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5fbc7a1e-c04b-4f3a-b4a5-f49d436f867a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6621543d2b7049589c44663b005a678a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:19.486046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=438c2ee579334d998e56d4d1e7278835)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:19.493014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: WARNING py.warnings [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:46:19.493014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: warnings.warn(msg) Jul 18 08:46:19.493014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: Jul 18 08:46:19.494821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:19.686550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 819/1641] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:18 2022] DELETE /identity/v3/users/6621543d2b7049589c44663b005a678a => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:20.038675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438c2ee579334d998e56d4d1e7278835'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:20.040586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438c2ee579334d998e56d4d1e7278835'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:20.115123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438c2ee579334d998e56d4d1e7278835'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:20.158949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438c2ee579334d998e56d4d1e7278835'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:20.162172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438c2ee579334d998e56d4d1e7278835'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:20.364020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 823/1642] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:19 2022] DELETE /identity/v3/users/438c2ee579334d998e56d4d1e7278835 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:20.375208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:20.376844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:20.378369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:20.466185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:20.475841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:20.727791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 820/1643] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:20.788717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:20.791070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:20.930992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:20.954558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fef9e-4bc5-4fc6-b22f-03bdce493cca admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:20.963458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f5f26-cefb-4785-9ea1-e3748b7a7bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:20.964465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5f26-cefb-4785-9ea1-e3748b7a7bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:20.973423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5f26-cefb-4785-9ea1-e3748b7a7bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:20.974324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5f26-cefb-4785-9ea1-e3748b7a7bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:21.015305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f5f26-cefb-4785-9ea1-e3748b7a7bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:21.020338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f5f26-cefb-4785-9ea1-e3748b7a7bb0 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:21.053467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 824/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:46:22.167767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:22.170767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:22.219861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b886bf-5c3d-4b04-aed4-99736c24b11a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:22.242443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:22.243894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:22.244407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:22.244922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] PATH_INFO: `/v3/projects/d3a21a819bab464b876a1ef746e5017d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:22.252367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a21a819bab464b876a1ef746e5017d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:22.262679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:46:22.262679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 18 08:46:22.262679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: Jul 18 08:46:22.265177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:22.603373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a21a819bab464b876a1ef746e5017d', 'request_id': 'req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:22.692547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a21a819bab464b876a1ef746e5017d', 'request_id': 'req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:22.710229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a21a819bab464b876a1ef746e5017d', 'request_id': 'req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:22.754669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] The token cache is being invalidate because project d3a21a819bab464b876a1ef746e5017d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:22.755093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:22.756838 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7294ed4-99e7-4ddd-80d5-ecd8dc25751d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:22.763453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 821/1645] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:22 2022] DELETE /identity/v3/projects/d3a21a819bab464b876a1ef746e5017d => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:22.779453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec221b-66e0-4cc1-8990-61d298f2e3d2 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:22.782767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec221b-66e0-4cc1-8990-61d298f2e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:22.785251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec221b-66e0-4cc1-8990-61d298f2e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:22.865012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-48ec221b-66e0-4cc1-8990-61d298f2e3d2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:22.868433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-48ec221b-66e0-4cc1-8990-61d298f2e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:23.173315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 825/1646] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:23.179118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fed23e-8efe-4633-9758-dda34985cd1e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:23.180101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fed23e-8efe-4633-9758-dda34985cd1e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:23.180580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fed23e-8efe-4633-9758-dda34985cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:23.216049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-11fed23e-8efe-4633-9758-dda34985cd1e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:23.218671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-11fed23e-8efe-4633-9758-dda34985cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:23.229294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 822/1647] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:23.236665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec221b-66e0-4cc1-8990-61d298f2e3d2 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:23.257273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec221b-66e0-4cc1-8990-61d298f2e3d2 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:23.285550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:23.286575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:23.287108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:23.287537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:23.288466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:23.288921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:23.294500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:23.341401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 826/1648] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:23.348630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fed23e-8efe-4633-9758-dda34985cd1e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:23.377604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:23.377604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:23.407080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fed23e-8efe-4633-9758-dda34985cd1e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:23.422554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f04b1-3617-4c1d-87cc-e7994a99578a admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:23.429746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:23.437552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:23.437552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:23.437552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:23.440827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:23.449625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:23.450658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:23.451803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:23.465211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:23.465908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] PATH_INFO: `/v3/users/af0797b9505b49bb8ea04e7114ea71b3` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:23.470371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0797b9505b49bb8ea04e7114ea71b3)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:23.476002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:23.649781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 823/1649] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:23 2022] POST /identity/v3/projects => generated 387 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:23.658604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:23.658604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:23.706020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:23.802182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea5f81-570e-4b5a-828e-7ccff92a7d37 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:23.809083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:23.810571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:23.811524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:23.812036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] PATH_INFO: `/v3/projects/d3e8fbe275464acfbf5c23b8aac62336` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:23.813651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e8fbe275464acfbf5c23b8aac62336)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:23.816362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:23.827313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0797b9505b49bb8ea04e7114ea71b3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:23.828677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0797b9505b49bb8ea04e7114ea71b3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:23.858079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0797b9505b49bb8ea04e7114ea71b3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:23.877802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0797b9505b49bb8ea04e7114ea71b3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:23.878600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0797b9505b49bb8ea04e7114ea71b3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:24.026548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 827/1650] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:23 2022] DELETE /identity/v3/users/af0797b9505b49bb8ea04e7114ea71b3 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:24.026548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:24.026548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:24.069417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e8fbe275464acfbf5c23b8aac62336', 'request_id': 'req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:24.167134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e8fbe275464acfbf5c23b8aac62336', 'request_id': 'req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:24.177194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:24.185949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e8fbe275464acfbf5c23b8aac62336', 'request_id': 'req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:24.206923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771e045-a11d-406e-9ced-405045bdd9ef admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:24.225620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] The token cache is being invalidate because project d3e8fbe275464acfbf5c23b8aac62336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:24.225957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:24.232949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-674d6a6a-f6bf-44a6-a7f4-b81f3a38d4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:24.243907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 824/1651] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:23 2022] DELETE /identity/v3/projects/d3e8fbe275464acfbf5c23b8aac62336 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:24.246803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7f4a-f282-4cf2-9320-512d0d5b77a7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.247296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7f4a-f282-4cf2-9320-512d0d5b77a7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.247796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7f4a-f282-4cf2-9320-512d0d5b77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.288715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0fabb-9eec-49d8-8aac-45b411c88e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:24.289527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0fabb-9eec-49d8-8aac-45b411c88e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.289843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0fabb-9eec-49d8-8aac-45b411c88e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.290574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0fabb-9eec-49d8-8aac-45b411c88e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.291677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0fabb-9eec-49d8-8aac-45b411c88e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:24.296711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0fabb-9eec-49d8-8aac-45b411c88e73 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:24.298129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1f1b7f4a-f282-4cf2-9320-512d0d5b77a7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:24.302016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1f1b7f4a-f282-4cf2-9320-512d0d5b77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:24.319776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 825/1652] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:24.321530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.322022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.322476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.354652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:24.357083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:24.384962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 826/1653] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:24.394515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:24.398989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:24.440472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 828/1654] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:24 2022] POST /identity/v3/users => generated 294 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:24.446013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.446309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.446592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.541098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:24.555233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:24.607365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 829/1655] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:24.608696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:24.611751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:24.640904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c231107-96cc-4d03-817b-b97a18cd3c1b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:24.650834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b28427-2413-43ab-bec1-0b4c81935eb4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:24.656044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:24.664935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:24.666125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.667241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.667241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.676175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.677025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.679062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.681187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:24.686797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:24.707210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:24.720198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:24.727502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 830/1656] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:24.728513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:24.763290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 827/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:24.765818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663a0d-28d8-48f0-a920-53472212c8f8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:24.767839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:24.783968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:24.785414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.785414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.785414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.786117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:24.786464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:24.790557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:24.811543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1f5ed-0116-4167-837d-257d27d3d436 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:24.834533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:24.834951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.835340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.835817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.842012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 831/1658] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:24.842701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:24.842701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:24.843258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:24.869836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b9c12-43b3-482d-83b9-bd833a76d9b3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:24.890992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:24.891708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.891987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.892293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.892982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:24.897099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 828/1659] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:24.897394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:24.899019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:24.920813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317c021-1f27-4737-9447-9138f448bc0b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:24.934410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a2bba-447b-4894-b98c-a99d5d4d9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:24.937165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a2bba-447b-4894-b98c-a99d5d4d9788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:24.938254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a2bba-447b-4894-b98c-a99d5d4d9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:24.939043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a2bba-447b-4894-b98c-a99d5d4d9788 admin admin] PATH_INFO: `/v3/projects/4b6b7e97a8c44de4b98a546a3445ed41/users/4d5e8395a52548c3bb066112c551a6ce/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:24.998359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a2bba-447b-4894-b98c-a99d5d4d9788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6b7e97a8c44de4b98a546a3445ed41, user_id=4d5e8395a52548c3bb066112c551a6ce, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:25.013666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a2bba-447b-4894-b98c-a99d5d4d9788 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:25.073013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 832/1660] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:24 2022] POST /identity/v3/projects => generated 405 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:25.078725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:25.174582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 829/1661] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:24 2022] PUT /identity/v3/projects/4b6b7e97a8c44de4b98a546a3445ed41/users/4d5e8395a52548c3bb066112c551a6ce/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:25.191707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b713-a8e3-4184-8f18-d104642d0f56 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:25.192743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b713-a8e3-4184-8f18-d104642d0f56 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:25.192743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b713-a8e3-4184-8f18-d104642d0f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:25.251595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:25.302295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fbd4b713-a8e3-4184-8f18-d104642d0f56 None None] MFA Rules not processed for user `4d5e8395a52548c3bb066112c551a6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:25.304607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fbd4b713-a8e3-4184-8f18-d104642d0f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:25.368084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb366-6579-499a-ba15-d15b16591acc admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:25.550800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 830/1662] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:25.561004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4b713-a8e3-4184-8f18-d104642d0f56 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:25.617506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:25.619861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:25.621609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:25.622547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:25.624553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:25.632548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:25.820503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4b713-a8e3-4184-8f18-d104642d0f56 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:25.830527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:25.831420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:25.831864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:25.832280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:25.846494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:25.848996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:25.858604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 833/1663] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:25 2022] POST /identity/v3/users => generated 303 bytes in 778 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:25.864887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:25.915625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310f91-585b-4bfc-a80c-9e7528078168 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:25.938290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:25.959691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:25.960566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:25.961600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:25.967398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:25.967878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:26.003246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 834/1664] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:26.005144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:26.027763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edbe59-ebf9-4a40-9bf0-e58c0a9c1913 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:26.045028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:26.046623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:26.047314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:26.048021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:26.049742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:26.055846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:26.068271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 831/1665] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:25 2022] POST /identity/v3/projects => generated 387 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:26.070234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:26.103225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 835/1666] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:26.104662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:26.129158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b08d-4ce8-45e5-b8e6-27106613daa2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:26.164984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:26.309654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:26.311504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:26.312072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:26.312576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] PATH_INFO: `/v3/projects/6f1cfae1a2ad4ede95950fc364bdd931/users/b267bf0c935c42c9a57381025196cffa/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:26.314377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeedaef-18fb-4864-8e39-4538b72e9904 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:26.337528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:26.339211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:26.340068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:26.340831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:26.342509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:26.346730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:26.356290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1cfae1a2ad4ede95950fc364bdd931, user_id=b267bf0c935c42c9a57381025196cffa, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:26.391355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:26.529810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 832/1667] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:26 2022] POST /identity/v3/users => generated 300 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:26.531400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:26.536802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:26.554851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 836/1668] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:26 2022] PUT /identity/v3/projects/6f1cfae1a2ad4ede95950fc364bdd931/users/b267bf0c935c42c9a57381025196cffa/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:26.556780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:26.577641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a18b-1c6a-481d-ba9a-8240e6852cf8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:26.767058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:26.769738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:26.779421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126fc25-9c67-46e4-8dd7-4c0ac4690944 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:26.779997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:26.780448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] PATH_INFO: `/v3/projects/1b45146dbba842499dffbcd29ef8a86a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:26.782461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b45146dbba842499dffbcd29ef8a86a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:26.785107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:26.797570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe151b-86b7-4861-a6c6-8671eceee2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:26.800086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe151b-86b7-4861-a6c6-8671eceee2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:26.800086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe151b-86b7-4861-a6c6-8671eceee2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:26.800086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe151b-86b7-4861-a6c6-8671eceee2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:26.801273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe151b-86b7-4861-a6c6-8671eceee2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:26.803547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe151b-86b7-4861-a6c6-8671eceee2d1 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:26.845358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 837/1669] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:26.845358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640b823-9259-40ce-9d01-eb81be49c5bf None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:26.845358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640b823-9259-40ce-9d01-eb81be49c5bf None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:26.845358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640b823-9259-40ce-9d01-eb81be49c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:26.921428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2640b823-9259-40ce-9d01-eb81be49c5bf None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:26.922974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2640b823-9259-40ce-9d01-eb81be49c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:26.943422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 838/1670] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:26.943422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640b823-9259-40ce-9d01-eb81be49c5bf None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:26.958245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:26.973653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640b823-9259-40ce-9d01-eb81be49c5bf None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:26.994431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b45146dbba842499dffbcd29ef8a86a', 'request_id': 'req-19c22c6c-586c-44cf-a100-00a46bb2b20a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:27.134705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eac838-26a9-44c7-a991-c39d48e0e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:27.137895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b45146dbba842499dffbcd29ef8a86a', 'request_id': 'req-19c22c6c-586c-44cf-a100-00a46bb2b20a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:27.141069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eac838-26a9-44c7-a991-c39d48e0e43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:27.141896 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eac838-26a9-44c7-a991-c39d48e0e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:27.143880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eac838-26a9-44c7-a991-c39d48e0e43a admin admin] PATH_INFO: `/v3/projects/6bde47d9402f4cd1b50e68b121f81ff1/users/1bed485234af4b02911025932601af97/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:27.148073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b45146dbba842499dffbcd29ef8a86a', 'request_id': 'req-19c22c6c-586c-44cf-a100-00a46bb2b20a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:27.184572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] The token cache is being invalidate because project 1b45146dbba842499dffbcd29ef8a86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:27.185664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:27.186240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:27.191639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eac838-26a9-44c7-a991-c39d48e0e43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bde47d9402f4cd1b50e68b121f81ff1, user_id=1bed485234af4b02911025932601af97, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:27.192168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 833/1671] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:26 2022] DELETE /identity/v3/projects/1b45146dbba842499dffbcd29ef8a86a => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:27.193547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:27.198716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:27.198921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eac838-26a9-44c7-a991-c39d48e0e43a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:27.345578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 839/1672] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:26 2022] PUT /identity/v3/projects/6bde47d9402f4cd1b50e68b121f81ff1/users/1bed485234af4b02911025932601af97/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:27.354817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:27.360392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:27.360902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:27.377232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c22c6c-586c-44cf-a100-00a46bb2b20a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:27.462339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:27.470823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:27.524004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:27.640261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:27.641482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:27.642020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:27.642501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:27.658808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:27.701835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 840/1673] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:27.705323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:27.710102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:27.736721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567964-ab28-41d6-971a-4cc3324b3e17 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:27.744980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636d82c-789a-4f40-add6-f81f66368b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:27.744980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636d82c-789a-4f40-add6-f81f66368b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:27.744980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636d82c-789a-4f40-add6-f81f66368b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:27.744980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636d82c-789a-4f40-add6-f81f66368b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:27.746222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636d82c-789a-4f40-add6-f81f66368b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:27.747668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636d82c-789a-4f40-add6-f81f66368b46 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:27.766910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 841/1674] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:27.769326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee135a-8ba1-4db9-b116-91caeffb223b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:27.770126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee135a-8ba1-4db9-b116-91caeffb223b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:27.772585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee135a-8ba1-4db9-b116-91caeffb223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:27.840227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0fee135a-8ba1-4db9-b116-91caeffb223b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:27.841783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0fee135a-8ba1-4db9-b116-91caeffb223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:27.843663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:27.847544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:27.871482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 842/1675] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:27.872582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee135a-8ba1-4db9-b116-91caeffb223b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:27.902744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 834/1676] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:27.903294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee135a-8ba1-4db9-b116-91caeffb223b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:27.904382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:27.925063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1aa43-5d00-45ea-babd-e65cc97abe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:27.925853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1aa43-5d00-45ea-babd-e65cc97abe2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:27.926685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1aa43-5d00-45ea-babd-e65cc97abe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:27.931558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1aa43-5d00-45ea-babd-e65cc97abe2a admin admin] PATH_INFO: `/v3/projects/6bde47d9402f4cd1b50e68b121f81ff1/users/1bed485234af4b02911025932601af97/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:27.931558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1aa43-5d00-45ea-babd-e65cc97abe2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bde47d9402f4cd1b50e68b121f81ff1, user_id=1bed485234af4b02911025932601af97, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:27.947470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1aa43-5d00-45ea-babd-e65cc97abe2a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:27.959177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb6fe1-c0c4-4325-9e58-604c5c44c0a4 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:27.976098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:27.977530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:27.978269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:27.978964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:27.980093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:27.987104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:27.990082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 843/1677] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:27 2022] PUT /identity/v3/projects/6bde47d9402f4cd1b50e68b121f81ff1/users/1bed485234af4b02911025932601af97/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:27.993609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:28.004001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:28.006032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:28.006032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:28.054009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 835/1678] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:28.084678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] MFA Rules not processed for user `1bed485234af4b02911025932601af97`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:28.084678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:28.091721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:28.123661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae753ec-6d61-47eb-b857-259facf896e8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:28.189102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:28.237397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 844/1679] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:28.265712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:28.268835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:28.433903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:28.436462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:28.442064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:28.443794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:28.444917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:28.454871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:28.473255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde2ad9-b29f-4021-927e-34396adc42ac None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:28.498522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:28.499963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:28.500509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:28.501020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:28.530363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:28.535037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:28.565886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 845/1680] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:46:28.650019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:28.652946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:28.694826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592bd40-76dd-4d55-a8a3-3fe2a9afe3a6 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:28.699310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 836/1681] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:28 2022] POST /identity/v3/projects => generated 355 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:28.702096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:28.736130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:28.888525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:28.889624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:28.890277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:28.890681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] PATH_INFO: `/v3/users/cdcf60e64d654b1eb4154a007ccfcba8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:28.893263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcf60e64d654b1eb4154a007ccfcba8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:28.898981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:29.121956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe72be8-95fb-4ddb-bd3c-d223178f5d38 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:29.153502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcf60e64d654b1eb4154a007ccfcba8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.154836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcf60e64d654b1eb4154a007ccfcba8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.156137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed7f8e-25fc-495d-a48e-b116679e07d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:29.171646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7f8e-25fc-495d-a48e-b116679e07d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:29.172482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7f8e-25fc-495d-a48e-b116679e07d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:29.180043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7f8e-25fc-495d-a48e-b116679e07d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:29.180043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed7f8e-25fc-495d-a48e-b116679e07d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:29.180043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed7f8e-25fc-495d-a48e-b116679e07d4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:29.188240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcf60e64d654b1eb4154a007ccfcba8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.198082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcf60e64d654b1eb4154a007ccfcba8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.199066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcf60e64d654b1eb4154a007ccfcba8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.357517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 846/1682] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:28 2022] DELETE /identity/v3/users/cdcf60e64d654b1eb4154a007ccfcba8 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:46:29.358607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:29.361856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:29.371601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 837/1683] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:28 2022] POST /identity/v3/users => generated 278 bytes in 674 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:29.374125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10c66-8675-4815-a0a5-ed5c69dacb37 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:29.374829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10c66-8675-4815-a0a5-ed5c69dacb37 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:29.375680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10c66-8675-4815-a0a5-ed5c69dacb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:29.493347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-75f10c66-8675-4815-a0a5-ed5c69dacb37 None None] MFA Rules not processed for user `a5bbefa9f11b462baa345257b9f3709d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:29.495323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-75f10c66-8675-4815-a0a5-ed5c69dacb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:29.506920 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc1b2d-4f7a-442d-8850-e1f9770f0d52 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:29.514992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:29.527550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:29.529451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:29.529778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:29.530286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] PATH_INFO: `/v3/users/4d5e8395a52548c3bb066112c551a6ce` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:29.535484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5e8395a52548c3bb066112c551a6ce)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:29.546069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:29.571667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:29.669249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 838/1684] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:29.670875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:29.671166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:29.671460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:29.697561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:29.699495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:29.710709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 839/1685] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:29.711559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:29.718212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:29.734924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422786fe-3495-4bec-b766-76e7c2410c18 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:29.743696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:29.746784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:29.746784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:29.746784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:29.751983 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:29.754290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:29.772756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 840/1686] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:29.775394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:29.777565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:29.817653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5e8395a52548c3bb066112c551a6ce'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.819753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5e8395a52548c3bb066112c551a6ce'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.883125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5e8395a52548c3bb066112c551a6ce'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.906093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5e8395a52548c3bb066112c551a6ce'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.907643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5e8395a52548c3bb066112c551a6ce'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:29.951535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286995-0b88-4925-980d-e8cebc051fa7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:29.970189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:29.971101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:29.971513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:29.971910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:29.974362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:29.988667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:29.992657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:30.018958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 841/1687] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:30.022359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:30.025860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:30.038074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 847/1688] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:29 2022] DELETE /identity/v3/users/4d5e8395a52548c3bb066112c551a6ce => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:30.049601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:30.058950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:30.209624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13cdc1-eea0-496f-a0e7-afadd97845a7 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:30.267643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:30.320249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:30.324535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:30.324535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:30.324535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:30.326653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:30.403061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e29290-5272-460b-ae19-17024e4f04ad admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:30.429799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc6fb-d4c2-4108-873e-aa9b49d23bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:30.431374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc6fb-d4c2-4108-873e-aa9b49d23bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:30.432277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc6fb-d4c2-4108-873e-aa9b49d23bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:30.433344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc6fb-d4c2-4108-873e-aa9b49d23bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:30.435275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fc6fb-d4c2-4108-873e-aa9b49d23bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:30.441627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fc6fb-d4c2-4108-873e-aa9b49d23bcc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:30.484465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:30.486529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:30.510869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 848/1689] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:30.514562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 842/1690] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:30.520193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e87a-5b19-4f04-a2f7-7dc6eb40411d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:30.520423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:30.521053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e87a-5b19-4f04-a2f7-7dc6eb40411d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:30.522394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e87a-5b19-4f04-a2f7-7dc6eb40411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:30.538458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a1b3a-f480-48f4-b630-0219059601f1 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:30.561811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:30.563368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:30.563776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:30.564277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] PATH_INFO: `/v3/projects/4fd1a0bb3dcb4065aaeb0a07258b3bda/users/2d0cd750c4274aa6bf4c9ae7202bc7c2/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:30.602419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd1a0bb3dcb4065aaeb0a07258b3bda, user_id=2d0cd750c4274aa6bf4c9ae7202bc7c2, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:30.610295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:30.619562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a074e87a-5b19-4f04-a2f7-7dc6eb40411d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:30.627656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a074e87a-5b19-4f04-a2f7-7dc6eb40411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:30.673033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 849/1691] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:30.718635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 843/1692] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:30 2022] PUT /identity/v3/projects/4fd1a0bb3dcb4065aaeb0a07258b3bda/users/2d0cd750c4274aa6bf4c9ae7202bc7c2/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:30.740780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270e16-3bc3-4bca-9be5-d9ff6ab26050 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:30.741288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270e16-3bc3-4bca-9be5-d9ff6ab26050 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:30.742028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270e16-3bc3-4bca-9be5-d9ff6ab26050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:30.791948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:30.795489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:30.886720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-42270e16-3bc3-4bca-9be5-d9ff6ab26050 None None] MFA Rules not processed for user `2d0cd750c4274aa6bf4c9ae7202bc7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:30.889162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-42270e16-3bc3-4bca-9be5-d9ff6ab26050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:30.985766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:31.090713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d49be-f6f4-41a9-8246-6bceb1b68535 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:31.099901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:31.100824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:31.101285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:31.101783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:31.219425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 850/1693] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:30 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:31.225402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270e16-3bc3-4bca-9be5-d9ff6ab26050 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:31.299261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:31.308968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:31.320518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:31.349072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 844/1694] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:31.414132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270e16-3bc3-4bca-9be5-d9ff6ab26050 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:31.435766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:31.437576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:31.446064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:31.446064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:31.446064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:31.446064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:31.660747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 851/1695] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:31 2022] POST /identity/v3/projects => generated 357 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:31.665429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:31.698472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61aea6-b39d-4162-bb25-6f915a94baec service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:31.981095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:31.982807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:31.983317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:31.983883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:31.985246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:31.989561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:32.083342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:32.086898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:32.145500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87aa58-e167-4978-af56-6f45b41acbb7 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:32.195016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:32.198967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:32.203297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:32.203825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] PATH_INFO: `/v3/projects/de15ad4e78084e4983036723d2bc61fa` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:32.216951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de15ad4e78084e4983036723d2bc61fa)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:32.220119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 845/1696] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:31 2022] POST /identity/v3/users => generated 285 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:32.222844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:32.228465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:32.296738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786418c1-5468-40de-ba97-959c62c5244d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:32.317052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:32.318902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:32.319650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:32.320328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:32.327370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:32.330987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:32.385963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 846/1697] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:32.391819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:32.431549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864747-0840-438b-9bf6-0a67e43a2bca admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:32.449339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:32.451809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:32.453030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:32.456022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] PATH_INFO: `/v3/projects/715277ae22f341e295c0d70209491bd5/users/ea0b9fa0c6ac44f497b43b2f497ce56b/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:32.555286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de15ad4e78084e4983036723d2bc61fa', 'request_id': 'req-d8ecc019-daa2-4812-acdc-45ae850bb205'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:32.563007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715277ae22f341e295c0d70209491bd5, user_id=ea0b9fa0c6ac44f497b43b2f497ce56b, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:32.572535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:32.585446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de15ad4e78084e4983036723d2bc61fa', 'request_id': 'req-d8ecc019-daa2-4812-acdc-45ae850bb205'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:32.619867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de15ad4e78084e4983036723d2bc61fa', 'request_id': 'req-d8ecc019-daa2-4812-acdc-45ae850bb205'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:32.754887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 847/1698] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:32 2022] PUT /identity/v3/projects/715277ae22f341e295c0d70209491bd5/users/ea0b9fa0c6ac44f497b43b2f497ce56b/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:32.758254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] The token cache is being invalidate because project de15ad4e78084e4983036723d2bc61fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:32.759514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:32.761555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:32.764653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d8ecc019-daa2-4812-acdc-45ae850bb205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:32.776017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 852/1699] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:32 2022] DELETE /identity/v3/projects/de15ad4e78084e4983036723d2bc61fa => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:32.782666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015aaa5-b36c-4ba2-90b4-40ce4cbab8d5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:32.783192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015aaa5-b36c-4ba2-90b4-40ce4cbab8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:32.783661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015aaa5-b36c-4ba2-90b4-40ce4cbab8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:32.878706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a015aaa5-b36c-4ba2-90b4-40ce4cbab8d5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:32.883493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a015aaa5-b36c-4ba2-90b4-40ce4cbab8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:33.003692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:33.079915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605772a-82f6-493d-965a-c2b555047941 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:33.122587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:33.126748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:33.136896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:33.140893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:33.144741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:33.154883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:33.222214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 848/1700] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:46:33.228881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:33.245721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 853/1701] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:33.246023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d8a4-512a-489a-b8b7-2625f7c83949 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:33.246710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d8a4-512a-489a-b8b7-2625f7c83949 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:33.247367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d8a4-512a-489a-b8b7-2625f7c83949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:33.252280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:33.326098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1536b-9cd8-4e08-bc26-0d56d361db6e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:33.341811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b3a75-1771-4584-8f36-9715ab95931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:33.345780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3a75-1771-4584-8f36-9715ab95931c admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:33.346555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3a75-1771-4584-8f36-9715ab95931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:33.347268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3a75-1771-4584-8f36-9715ab95931c admin admin] PATH_INFO: `/v3/projects/715277ae22f341e295c0d70209491bd5/users/ea0b9fa0c6ac44f497b43b2f497ce56b/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:33.360887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b3a75-1771-4584-8f36-9715ab95931c admin admin] RBAC: Authorizing `identity:create_grant(project_id=715277ae22f341e295c0d70209491bd5, user_id=ea0b9fa0c6ac44f497b43b2f497ce56b, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:33.363153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-04e3d8a4-512a-489a-b8b7-2625f7c83949 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:33.367289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-04e3d8a4-512a-489a-b8b7-2625f7c83949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:33.389763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b3a75-1771-4584-8f36-9715ab95931c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:33.425907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 854/1702] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:46:33.428779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d8a4-512a-489a-b8b7-2625f7c83949 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:33.433047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 849/1703] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:33 2022] PUT /identity/v3/projects/715277ae22f341e295c0d70209491bd5/users/ea0b9fa0c6ac44f497b43b2f497ce56b/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:46:33.493954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d8a4-512a-489a-b8b7-2625f7c83949 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:33.504647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:33.505355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:33.505834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:33.661608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] MFA Rules not processed for user `ea0b9fa0c6ac44f497b43b2f497ce56b`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:33.662912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:33.727108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:33.910294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 850/1704] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:33 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:46:33.937754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:33.940883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:33.942037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:33.942625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:33.943200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:33.947968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:33.949139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:33.949813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:33.962044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:34.020777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 855/1705] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 590 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:34.023101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:34.075750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a753c-1baf-4bd0-81c8-3c96a3fb66c7 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:34.101564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:34.102911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:34.103512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:34.104047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:34.107020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:34.112949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:34.169533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8ae1-280e-4afb-b3c6-e59b7a28c5c9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:34.178389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:34.179955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:34.180554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:34.181224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:34.212006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:34.216666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:34.254026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 851/1706] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:33 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:34.449437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 856/1707] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:34 2022] POST /identity/v3/projects => generated 405 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:46:34.457855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:34.517412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae961c-960b-415f-b7dc-58430497afa5 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:34.764730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:34.765462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:34.765663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:34.766060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:34.766863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:34.769115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:34.802022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:34.915126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 852/1708] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:34 2022] POST /identity/v3/users => generated 303 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:34.921861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:34.928746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:35.020010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3448d0-b127-4859-a724-410755846533 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:35.040513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721efc07-3fc7-449d-82b0-2aaf9639a434 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:35.043018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:35.043018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:35.043533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:35.043822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] PATH_INFO: `/v3/projects/4b6b7e97a8c44de4b98a546a3445ed41` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:35.050355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6b7e97a8c44de4b98a546a3445ed41)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:35.052525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:35.061811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:35.063109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:35.063623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:35.064155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:35.074816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:35.310178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:35.355221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:35.364345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6b7e97a8c44de4b98a546a3445ed41', 'request_id': 'req-b539f5a9-b384-4d9e-bf76-2c9162e425ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:35.392598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:35.397945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:35.454187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 857/1709] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:34 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:35.456660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:35.464708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6b7e97a8c44de4b98a546a3445ed41', 'request_id': 'req-b539f5a9-b384-4d9e-bf76-2c9162e425ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:35.492575 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6b7e97a8c44de4b98a546a3445ed41', 'request_id': 'req-b539f5a9-b384-4d9e-bf76-2c9162e425ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:35.528612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b83b1-e81e-4784-bd48-0790be9c9745 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:35.555613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] The token cache is being invalidate because project 4b6b7e97a8c44de4b98a546a3445ed41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:35.555613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:35.558673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b539f5a9-b384-4d9e-bf76-2c9162e425ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:35.574169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 853/1710] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:34 2022] DELETE /identity/v3/projects/4b6b7e97a8c44de4b98a546a3445ed41 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:35.574169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:35.574169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:35.574169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:35.820160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] MFA Rules not processed for user `696093856c864253a460e4b9362ce7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:35.836314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:35.941954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255407f-f8ae-4a8e-b2bc-28faa3c4a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:35.945578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255407f-f8ae-4a8e-b2bc-28faa3c4a986 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:35.949510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255407f-f8ae-4a8e-b2bc-28faa3c4a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:35.951323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255407f-f8ae-4a8e-b2bc-28faa3c4a986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:35.952801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255407f-f8ae-4a8e-b2bc-28faa3c4a986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:35.984556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255407f-f8ae-4a8e-b2bc-28faa3c4a986 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:36.073372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 858/1711] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 618 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:36.078401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:36.079536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:36.080301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:36.244950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] MFA Rules not processed for user `b267bf0c935c42c9a57381025196cffa`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:36.247386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:36.432106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 854/1712] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 852 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:36.437066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:36.445771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:36.503735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80dc78-17b4-4991-9481-d7570628e2ae None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:36.550018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:36.561652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:36.562267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:36.562769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] PATH_INFO: `/v3/users/1bed485234af4b02911025932601af97` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:36.578042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bed485234af4b02911025932601af97)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:36.581843 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:36.594600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 859/1713] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:36.594600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:36.597290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:36.640898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb5b3d-8be3-44c7-b526-375bb0b3514e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:36.649829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043b89-0752-4c25-977f-64ba168685d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:36.652605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043b89-0752-4c25-977f-64ba168685d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:36.653270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043b89-0752-4c25-977f-64ba168685d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:36.654246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043b89-0752-4c25-977f-64ba168685d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:36.657374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043b89-0752-4c25-977f-64ba168685d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:36.661619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043b89-0752-4c25-977f-64ba168685d8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:36.759569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 860/1714] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:36.764689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:36.767400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:36.768139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:36.821160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] MFA Rules not processed for user `696093856c864253a460e4b9362ce7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:36.827506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:36.852852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 861/1715] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:36.852852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:36.857641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:36.900074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bed485234af4b02911025932601af97'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:36.901304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bed485234af4b02911025932601af97'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:36.903995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044b08-6026-44d0-b755-821bfacbf71d None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:36.915213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:36.918758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:36.919826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:36.920533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:36.924456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:36.934909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:36.982592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bed485234af4b02911025932601af97'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:37.023036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bed485234af4b02911025932601af97'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:37.026214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bed485234af4b02911025932601af97'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:37.143328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 855/1716] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:36 2022] DELETE /identity/v3/users/1bed485234af4b02911025932601af97 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:37.144253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:37.149178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:37.154333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 862/1717] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:36 2022] POST /identity/v3/projects => generated 405 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:37.158834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:37.168259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:37.297728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:37.328836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:37.397037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c52a3-4b62-4883-9c8d-98b0f59a39f0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:37.408193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:37.414835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:37.415387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:37.415733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0e6a-7cfd-48d2-8fe7-3c6e0ca2914d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:37.431128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:37.431128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:37.613873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a95cd-b3f4-427d-a0fd-f129d8f0525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:37.614902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a95cd-b3f4-427d-a0fd-f129d8f0525e admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:37.615223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a95cd-b3f4-427d-a0fd-f129d8f0525e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:37.615622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a95cd-b3f4-427d-a0fd-f129d8f0525e admin admin] PATH_INFO: `/v3/projects/0ed35b3b3b3040c289732acc4be1f4b4/users/25166d7fe23b49d98b7c7219d7289822/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:37.638701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a95cd-b3f4-427d-a0fd-f129d8f0525e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed35b3b3b3040c289732acc4be1f4b4, user_id=25166d7fe23b49d98b7c7219d7289822, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:37.642464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a95cd-b3f4-427d-a0fd-f129d8f0525e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:37.692215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:37.701773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:37.754308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 863/1718] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:37.756326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:37.763474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:37.807929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 856/1719] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:37 2022] PUT /identity/v3/projects/0ed35b3b3b3040c289732acc4be1f4b4/users/25166d7fe23b49d98b7c7219d7289822/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:37.827881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b259f27-093d-4494-95b9-16f9f4c51f00 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:37.828401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b259f27-093d-4494-95b9-16f9f4c51f00 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:37.828892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b259f27-093d-4494-95b9-16f9f4c51f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:37.842569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552bb10-f7d2-4236-9437-59f0979be7f4 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:38.027074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4b259f27-093d-4494-95b9-16f9f4c51f00 None None] MFA Rules not processed for user `25166d7fe23b49d98b7c7219d7289822`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:38.038026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4b259f27-093d-4494-95b9-16f9f4c51f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:38.248866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:38.251353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:38.251845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:38.255639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:38.278562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:38.292659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:38.376054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 857/1720] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:38.378514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b259f27-093d-4494-95b9-16f9f4c51f00 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:38.416627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b259f27-093d-4494-95b9-16f9f4c51f00 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:38.426703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:38.428238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:38.428970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:38.429772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:38.431269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:38.435766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:38.450694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 864/1721] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:37 2022] POST /identity/v3/users => generated 309 bytes in 695 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:38.452134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:38.470008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7303-7a20-435d-a42d-9a7fb9ebb654 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:38.482609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:38.483539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:38.483977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:38.484449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:38.486850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:38.489371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:38.512725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 865/1722] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:38.515046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:38.537077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f0a0-d3a1-4444-bbb4-ea52252bd168 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:38.576375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdfd75-7576-49e9-9e34-5e8b57da6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:38.578094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdfd75-7576-49e9-9e34-5e8b57da6a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:38.580759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdfd75-7576-49e9-9e34-5e8b57da6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:38.581360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdfd75-7576-49e9-9e34-5e8b57da6a8a admin admin] PATH_INFO: `/v3/projects/6a6bfb735e304c409286389de06d725c/users/dd65cca4e6cd4123bd47863eaf69f94a/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:38.611750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 858/1723] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:38 2022] POST /identity/v3/projects => generated 405 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:38.615247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:38.648661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdfd75-7576-49e9-9e34-5e8b57da6a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6bfb735e304c409286389de06d725c, user_id=dd65cca4e6cd4123bd47863eaf69f94a, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:38.656858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdfd75-7576-49e9-9e34-5e8b57da6a8a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:38.820397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 866/1724] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:38 2022] PUT /identity/v3/projects/6a6bfb735e304c409286389de06d725c/users/dd65cca4e6cd4123bd47863eaf69f94a/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:38.832465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696f310-0559-41e2-baca-1316f37bf309 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:38.839026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696f310-0559-41e2-baca-1316f37bf309 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:38.840158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696f310-0559-41e2-baca-1316f37bf309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:38.963841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:39.066202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3696f310-0559-41e2-baca-1316f37bf309 None None] MFA Rules not processed for user `c048ce9cc5484139a3c5f87b4e204809`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:39.068916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3696f310-0559-41e2-baca-1316f37bf309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:39.111427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:39.115256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59dbe3-75f3-46fb-a471-213812b0ee47 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:39.350601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7930d-538e-4ac4-832e-71da9fd21ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:39.351747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7930d-538e-4ac4-832e-71da9fd21ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:39.352240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7930d-538e-4ac4-832e-71da9fd21ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:39.352733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7930d-538e-4ac4-832e-71da9fd21ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:39.362152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7930d-538e-4ac4-832e-71da9fd21ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:39.371852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7930d-538e-4ac4-832e-71da9fd21ef8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:39.397509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 867/1725] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:39.422676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696f310-0559-41e2-baca-1316f37bf309 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:39.455327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696f310-0559-41e2-baca-1316f37bf309 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:39.465222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc9b07-aaea-46f1-8f37-0e7110d4f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:39.466419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc9b07-aaea-46f1-8f37-0e7110d4f65f admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:39.467158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc9b07-aaea-46f1-8f37-0e7110d4f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:39.467632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc9b07-aaea-46f1-8f37-0e7110d4f65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:39.469090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc9b07-aaea-46f1-8f37-0e7110d4f65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:39.472498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc9b07-aaea-46f1-8f37-0e7110d4f65f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:39.502104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 868/1726] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:39.502104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8991c5-83ad-43e7-88cc-e6b4a16027cd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:39.502104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8991c5-83ad-43e7-88cc-e6b4a16027cd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:39.502104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8991c5-83ad-43e7-88cc-e6b4a16027cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:39.550931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2e8991c5-83ad-43e7-88cc-e6b4a16027cd None None] MFA Rules not processed for user `a5bbefa9f11b462baa345257b9f3709d`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:39.552731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2e8991c5-83ad-43e7-88cc-e6b4a16027cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:39.567232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 859/1727] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:38 2022] POST /identity/v3/users => generated 309 bytes in 955 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:39.569528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded01506-8164-4f34-801c-8777b58e42b0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:39.572795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded01506-8164-4f34-801c-8777b58e42b0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:39.573218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded01506-8164-4f34-801c-8777b58e42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:39.653877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ded01506-8164-4f34-801c-8777b58e42b0 None None] MFA Rules not processed for user `c048ce9cc5484139a3c5f87b4e204809`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:39.656012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ded01506-8164-4f34-801c-8777b58e42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:39.684944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 860/1728] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:39.694339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded01506-8164-4f34-801c-8777b58e42b0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:39.735872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded01506-8164-4f34-801c-8777b58e42b0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:39.742556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:39.743492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:39.743779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:39.744056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] PATH_INFO: `/v3/projects/6a6bfb735e304c409286389de06d725c/users/dd65cca4e6cd4123bd47863eaf69f94a/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:39.748441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6bfb735e304c409286389de06d725c, user_id=dd65cca4e6cd4123bd47863eaf69f94a, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:39.752895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:39.785037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 869/1729] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:39.786500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8991c5-83ad-43e7-88cc-e6b4a16027cd None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:39.794419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 861/1730] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:39 2022] PUT /identity/v3/projects/6a6bfb735e304c409286389de06d725c/users/dd65cca4e6cd4123bd47863eaf69f94a/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:39.800248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:39.805774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:39.839699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8991c5-83ad-43e7-88cc-e6b4a16027cd None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:40.085125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:40.085863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:40.088628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:40.088628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:40.091395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:40.094489 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf157c-0bae-4df3-8619-62b71157619d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:40.096494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:40.119833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:40.121392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:40.125632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:40.126174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:40.134772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 870/1731] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:40.136562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:40.147411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:40.185355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88251891-ef20-456a-86e5-1cf545140b5b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:40.200806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:40.201852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:40.202746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:40.209886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] PATH_INFO: `/v3/projects/6bde47d9402f4cd1b50e68b121f81ff1` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:40.209886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bde47d9402f4cd1b50e68b121f81ff1)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:40.215668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:40.422988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:40.423628 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:40.455165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bde47d9402f4cd1b50e68b121f81ff1', 'request_id': 'req-eeaa4975-93e2-4c09-8862-fa61f76da9c7'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:40.478361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bde47d9402f4cd1b50e68b121f81ff1', 'request_id': 'req-eeaa4975-93e2-4c09-8862-fa61f76da9c7'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:40.489082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:40.501663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:40.501911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bde47d9402f4cd1b50e68b121f81ff1', 'request_id': 'req-eeaa4975-93e2-4c09-8862-fa61f76da9c7'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:40.583965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 862/1732] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:40.585338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:40.632879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eebb8-5348-4195-ba70-d457855696de service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:40.639798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] The token cache is being invalidate because project 6bde47d9402f4cd1b50e68b121f81ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:40.640440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:40.641551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-eeaa4975-93e2-4c09-8862-fa61f76da9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:40.644734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 871/1733] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:40 2022] DELETE /identity/v3/projects/6bde47d9402f4cd1b50e68b121f81ff1 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:40.648474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696706f-5b0d-41c1-9db1-f57220a304f7 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:40.652125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696706f-5b0d-41c1-9db1-f57220a304f7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:40.653206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696706f-5b0d-41c1-9db1-f57220a304f7 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:40.678031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 872/1734] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jul 18 08:46:40 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:40.684408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664b38-5ffb-4de2-a24a-ca8628740bda None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:40.684937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664b38-5ffb-4de2-a24a-ca8628740bda None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:40.685897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664b38-5ffb-4de2-a24a-ca8628740bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:40.787301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-62664b38-5ffb-4de2-a24a-ca8628740bda None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:40.789732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-62664b38-5ffb-4de2-a24a-ca8628740bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:40.978733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee675a9-2098-4f60-98d3-050a7d300d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:40.993334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee675a9-2098-4f60-98d3-050a7d300d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:40.994037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee675a9-2098-4f60-98d3-050a7d300d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:40.994836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee675a9-2098-4f60-98d3-050a7d300d70 admin admin] PATH_INFO: `/v3/projects/cfbf8d6c6d0e41abbe7e00f60214e173/users/65b17e9b5b5b4904adc55638dbfb569f/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:41.012586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 873/1735] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:41.014851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b0ca-cc5e-4b0a-ae6a-e3aead6e7ddd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:41.016393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b0ca-cc5e-4b0a-ae6a-e3aead6e7ddd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:41.016963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b0ca-cc5e-4b0a-ae6a-e3aead6e7ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:41.077045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee675a9-2098-4f60-98d3-050a7d300d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbf8d6c6d0e41abbe7e00f60214e173, user_id=65b17e9b5b5b4904adc55638dbfb569f, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:41.085758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee675a9-2098-4f60-98d3-050a7d300d70 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:41.170075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ae10b0ca-cc5e-4b0a-ae6a-e3aead6e7ddd None None] MFA Rules not processed for user `b40cb94150444c81ab1de3c6c1c1ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:41.179926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ae10b0ca-cc5e-4b0a-ae6a-e3aead6e7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:41.221084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 863/1736] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:40 2022] PUT /identity/v3/projects/cfbf8d6c6d0e41abbe7e00f60214e173/users/65b17e9b5b5b4904adc55638dbfb569f/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:41.222688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:41.222948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:41.223723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:41.273546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] MFA Rules not processed for user `e59b9b2fcf024b05a9d751a42713f012`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:41.276391 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:41.329137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 874/1737] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:41.339304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:41.341102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:41.343614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:41.463628 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 864/1738] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:41.463628 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:41.471193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:41.474702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:41.476288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:41.738650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28476-bbe2-4fd6-8c2d-36dc6ab1a4bd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:41.770590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3f55b-e5e2-4e49-8e3e-d8d80c56c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:41.770590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3f55b-e5e2-4e49-8e3e-d8d80c56c0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:41.770590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3f55b-e5e2-4e49-8e3e-d8d80c56c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:41.770590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3f55b-e5e2-4e49-8e3e-d8d80c56c0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:41.771225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3f55b-e5e2-4e49-8e3e-d8d80c56c0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:41.790497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3f55b-e5e2-4e49-8e3e-d8d80c56c0a9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:41.805865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:41.814894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 875/1739] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:41.817186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:41.823614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:41.841781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:41.846403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 865/1740] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:41.848656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d747-2422-4645-901d-394475b1d3a8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:41.849228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d747-2422-4645-901d-394475b1d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:41.849750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d747-2422-4645-901d-394475b1d3a8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:41.852066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 866/1741] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jul 18 08:46:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:41.853585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d747-2422-4645-901d-394475b1d3a8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:41.914214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d747-2422-4645-901d-394475b1d3a8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:41.922413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:41.923209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:41.923571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:41.924711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:41.926845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:41.927241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:41.929465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:41.949642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 867/1742] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:41.951042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:41.994389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6c2ab-a426-4850-a7f0-cca8fe3d7bd5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:42.006643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29848b86-7210-452d-be18-1db3f62f1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:42.021542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848b86-7210-452d-be18-1db3f62f1e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.024253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848b86-7210-452d-be18-1db3f62f1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.025968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848b86-7210-452d-be18-1db3f62f1e19 admin admin] PATH_INFO: `/v3/projects/cfbf8d6c6d0e41abbe7e00f60214e173/users/65b17e9b5b5b4904adc55638dbfb569f/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:42.029559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29848b86-7210-452d-be18-1db3f62f1e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbf8d6c6d0e41abbe7e00f60214e173, user_id=65b17e9b5b5b4904adc55638dbfb569f, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:42.033645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29848b86-7210-452d-be18-1db3f62f1e19 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:42.038345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f84d7-cf89-435f-ba3a-72d81d1c863b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:42.058710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 868/1743] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:41 2022] PUT /identity/v3/projects/cfbf8d6c6d0e41abbe7e00f60214e173/users/65b17e9b5b5b4904adc55638dbfb569f/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:42.061765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95e787-0d5b-4de9-a16f-07212f680a7a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.062124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95e787-0d5b-4de9-a16f-07212f680a7a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.062519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95e787-0d5b-4de9-a16f-07212f680a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:42.066391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:42.073897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.074680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.075646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:42.104150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bc95e787-0d5b-4de9-a16f-07212f680a7a None None] MFA Rules not processed for user `b40cb94150444c81ab1de3c6c1c1ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:42.110591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:42.112702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bc95e787-0d5b-4de9-a16f-07212f680a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:42.113667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:42.150591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 876/1744] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:42.153973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:42.211462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338940c-140c-416e-8895-94bb5a084132 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:42.279932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 869/1745] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:42.281575 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964083-b786-4912-bfb1-3868b1a60c92 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.282763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964083-b786-4912-bfb1-3868b1a60c92 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.286227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964083-b786-4912-bfb1-3868b1a60c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:42.349229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a9964083-b786-4912-bfb1-3868b1a60c92 None None] MFA Rules not processed for user `65b17e9b5b5b4904adc55638dbfb569f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:42.350747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a9964083-b786-4912-bfb1-3868b1a60c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:42.358041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:42.359547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.360121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.360691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:42.362214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:42.381894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:42.533630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 870/1746] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:42.553448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9964083-b786-4912-bfb1-3868b1a60c92 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:42.568959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9964083-b786-4912-bfb1-3868b1a60c92 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:42.576424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:42.577884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.578424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.579203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:42.594733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:42.597080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:42.616032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 871/1747] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:42.617135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:42.623909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:42.624123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 877/1748] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:42 2022] POST /identity/v3/projects => generated 393 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:42.626078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:42.836058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b0981-db0f-4539-86aa-98e19d3120f3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:42.849639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412088f-c305-46ca-90bb-a0117db9ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:42.850352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412088f-c305-46ca-90bb-a0117db9ea63 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.850632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412088f-c305-46ca-90bb-a0117db9ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.850911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412088f-c305-46ca-90bb-a0117db9ea63 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:42.852844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412088f-c305-46ca-90bb-a0117db9ea63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:42.859996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412088f-c305-46ca-90bb-a0117db9ea63 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:42.862941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28198120-4241-4f56-bbf4-27412ac4c5d6 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:42.892279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:42.960377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 878/1749] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:42 2022] POST /identity/v3/users => generated 297 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:42.966329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ad77-ab19-45df-abbc-6f6e2114ed28 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:42.966766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ad77-ab19-45df-abbc-6f6e2114ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:42.968097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ad77-ab19-45df-abbc-6f6e2114ed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:43.038452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:43.044475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:43.044475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:43.044475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:43.080939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c7e4ad77-ab19-45df-abbc-6f6e2114ed28 None None] MFA Rules not processed for user `dd65cca4e6cd4123bd47863eaf69f94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:43.082258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c7e4ad77-ab19-45df-abbc-6f6e2114ed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:43.126919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:43.268389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:43.269910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:43.322911 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 872/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:43.324885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:43.361809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 879/1751] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:43.375333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fbc19-031c-41e7-a697-d1de11e85db5 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:43.435212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:43.442411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:43.454478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:43.455408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:43.463198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:43.477279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:43.520226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 873/1752] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:43.528110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ad77-ab19-45df-abbc-6f6e2114ed28 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:43.561644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ad77-ab19-45df-abbc-6f6e2114ed28 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:43.605992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:43.607714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:43.608230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:43.608710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:43.619548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:43.628388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:43.654461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:43.657808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:43.731165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 880/1753] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:43.733007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:43.797626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352788-1be4-44ab-a2b8-5a776422235e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:43.837592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb1ac-200d-4540-81fe-b3e265320127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:43.839362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb1ac-200d-4540-81fe-b3e265320127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:43.840114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb1ac-200d-4540-81fe-b3e265320127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:43.840567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb1ac-200d-4540-81fe-b3e265320127 admin admin] PATH_INFO: `/v3/projects/5f5da843ecc14791993a6abcfd52128e/users/fa1b4789239947c08fc67ecb2f7696e2/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:43.936895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb1ac-200d-4540-81fe-b3e265320127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5da843ecc14791993a6abcfd52128e, user_id=fa1b4789239947c08fc67ecb2f7696e2, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:43.952693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb1ac-200d-4540-81fe-b3e265320127 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:43.956655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0895-db4f-4a8c-9b09-7116a71e7232 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:43.986108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:43.987247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:43.987744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:43.990745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:44.088105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:44.150996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:44.153661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:44.171485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 874/1754] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:44.173147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:44.180403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 881/1755] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:43 2022] PUT /identity/v3/projects/5f5da843ecc14791993a6abcfd52128e/users/fa1b4789239947c08fc67ecb2f7696e2/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:44.182033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307cd4-3733-46e8-8cdf-9600a5d80e6e None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:44.185174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307cd4-3733-46e8-8cdf-9600a5d80e6e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:44.185660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307cd4-3733-46e8-8cdf-9600a5d80e6e None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:44.191515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 882/1756] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 08:46:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:44.194051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f307cd4-3733-46e8-8cdf-9600a5d80e6e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:44.198207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86db5-7c32-46a9-9b34-3099040639c2 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:44.199607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6f307cd4-3733-46e8-8cdf-9600a5d80e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:44.353406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:44.354532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:44.354959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:44.355416 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] PATH_INFO: `/v3/users/25166d7fe23b49d98b7c7219d7289822` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:44.357844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25166d7fe23b49d98b7c7219d7289822)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:44.366357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:44.392814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f307cd4-3733-46e8-8cdf-9600a5d80e6e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:44.432103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc550f-fa83-419d-8b23-ed21da4ab400 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:44.436567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc550f-fa83-419d-8b23-ed21da4ab400 service placement] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:44.437773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc550f-fa83-419d-8b23-ed21da4ab400 service placement] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:44.440376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc550f-fa83-419d-8b23-ed21da4ab400 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:44.448050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-19dc550f-fa83-419d-8b23-ed21da4ab400 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:44.474863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc550f-fa83-419d-8b23-ed21da4ab400 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:44.478633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc550f-fa83-419d-8b23-ed21da4ab400 service placement] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:44.515970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 883/1757] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:44.530579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f8a5-93a2-4b9c-987d-e5356db9b4df None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:44.531558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f8a5-93a2-4b9c-987d-e5356db9b4df None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:44.534630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f8a5-93a2-4b9c-987d-e5356db9b4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:44.619106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b877f8a5-93a2-4b9c-987d-e5356db9b4df None None] MFA Rules not processed for user `fa1b4789239947c08fc67ecb2f7696e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:44.620730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b877f8a5-93a2-4b9c-987d-e5356db9b4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:44.662957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25166d7fe23b49d98b7c7219d7289822'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:44.665272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25166d7fe23b49d98b7c7219d7289822'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:44.695979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25166d7fe23b49d98b7c7219d7289822'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:44.719507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25166d7fe23b49d98b7c7219d7289822'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:44.720627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25166d7fe23b49d98b7c7219d7289822'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:44.767124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:44.832820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 884/1758] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:44.834900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a4d-9ce1-4fb2-b92c-b74a13b95d26 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:44.835204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a4d-9ce1-4fb2-b92c-b74a13b95d26 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:44.835625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a4d-9ce1-4fb2-b92c-b74a13b95d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:44.870708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-329a6a4d-9ce1-4fb2-b92c-b74a13b95d26 None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:44.872344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-329a6a4d-9ce1-4fb2-b92c-b74a13b95d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:44.914088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 875/1759] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:44 2022] DELETE /identity/v3/users/25166d7fe23b49d98b7c7219d7289822 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:44.915957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:44.925272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 885/1760] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 08:46:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:44.928877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:44.931276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2f34d-9775-4e04-b373-36621597fafa None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:44.931576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2f34d-9775-4e04-b373-36621597fafa None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:44.931859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2f34d-9775-4e04-b373-36621597fafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:45.058294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-48b2f34d-9775-4e04-b373-36621597fafa None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:45.063206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-48b2f34d-9775-4e04-b373-36621597fafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:45.232893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ddc7-ed96-427e-b794-f9d3cb550580 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:45.251021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 886/1761] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:45.252037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2f34d-9775-4e04-b373-36621597fafa None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:45.267623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cdaae-c923-4e08-8665-3cc8ac1108c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:45.267623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdaae-c923-4e08-8665-3cc8ac1108c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:45.267623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdaae-c923-4e08-8665-3cc8ac1108c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:45.268193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdaae-c923-4e08-8665-3cc8ac1108c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:45.269253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cdaae-c923-4e08-8665-3cc8ac1108c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:45.286819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cdaae-c923-4e08-8665-3cc8ac1108c7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:45.303675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:45.442164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2f34d-9775-4e04-b373-36621597fafa None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:45.452064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:45.452978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:45.453353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:45.453751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:45.456948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:45.486104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:45.489044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:45.506644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 887/1762] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:45.508934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:45.512139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:45.577742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 876/1763] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:44 2022] POST /identity/v3/projects => generated 393 bytes in 656 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:45.582435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3812d-d38f-4aa0-9876-ecc24d073e24 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:45.582895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3812d-d38f-4aa0-9876-ecc24d073e24 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:45.583289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3812d-d38f-4aa0-9876-ecc24d073e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:45.637051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-78f3812d-d38f-4aa0-9876-ecc24d073e24 None None] MFA Rules not processed for user `c048ce9cc5484139a3c5f87b4e204809`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:45.640938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-78f3812d-d38f-4aa0-9876-ecc24d073e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:45.679825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fefb1-30ce-4ad5-bd61-2cf707b69aaa service placement] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:45.788715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:45.854220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:45.855002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:45.855294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:45.855582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:45.861333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 877/1764] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:45.862780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3812d-d38f-4aa0-9876-ecc24d073e24 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:46.085856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3812d-d38f-4aa0-9876-ecc24d073e24 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:46.109298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:46.110386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:46.110677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:46.114671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:46.115877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:46.124447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:46.132526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:46.140881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:46.175536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 888/1765] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:46.329007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 878/1766] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:45 2022] POST /identity/v3/users => generated 303 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:46.331509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:46.344641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c162-7c9f-448a-a918-569b5ecb2fc9 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:46.351734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:46.353119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:46.353781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:46.354494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:46.356638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:46.359048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:46.378838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 889/1767] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:46.383517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:46.402646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c10c5-43a1-4134-af4a-5b1ec8811b0f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:46.444848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:46.450245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:46.454154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:46.456720 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] PATH_INFO: `/v3/projects/4e16a12aff4e4cc89fd99d9fd53e3ceb/users/c763a8ee5f9c41b49bc12972b0355a8e/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:46.513127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e16a12aff4e4cc89fd99d9fd53e3ceb, user_id=c763a8ee5f9c41b49bc12972b0355a8e, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:46.534930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:46.789567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 879/1768] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:46 2022] PUT /identity/v3/projects/4e16a12aff4e4cc89fd99d9fd53e3ceb/users/c763a8ee5f9c41b49bc12972b0355a8e/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:46:46.794845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:46.813252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940b5d9-cc7f-4d48-a052-e2c2c352d76a admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:47.076454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e45aa-9a00-4b0c-9424-66c5608bd916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:47.077923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e45aa-9a00-4b0c-9424-66c5608bd916 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:47.078989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e45aa-9a00-4b0c-9424-66c5608bd916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:47.081836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e45aa-9a00-4b0c-9424-66c5608bd916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:47.082861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e45aa-9a00-4b0c-9424-66c5608bd916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:47.085713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e45aa-9a00-4b0c-9424-66c5608bd916 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:47.111099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 890/1769] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:46:47.116326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:47.148110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca707a-7853-4f0c-bd6b-ed1fb757ea2c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:47.177741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9326e89-1d9a-4a21-bc96-8a14d83957e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:47.179223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326e89-1d9a-4a21-bc96-8a14d83957e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:47.179223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326e89-1d9a-4a21-bc96-8a14d83957e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:47.179223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326e89-1d9a-4a21-bc96-8a14d83957e2 admin admin] PATH_INFO: `/v3/projects/4e16a12aff4e4cc89fd99d9fd53e3ceb/users/c763a8ee5f9c41b49bc12972b0355a8e/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:47.191973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9326e89-1d9a-4a21-bc96-8a14d83957e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e16a12aff4e4cc89fd99d9fd53e3ceb, user_id=c763a8ee5f9c41b49bc12972b0355a8e, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:47.203792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9326e89-1d9a-4a21-bc96-8a14d83957e2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:47.255609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 880/1770] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:47 2022] PUT /identity/v3/projects/4e16a12aff4e4cc89fd99d9fd53e3ceb/users/c763a8ee5f9c41b49bc12972b0355a8e/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:47.266799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:47.267151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:47.270164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:47.326651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] MFA Rules not processed for user `c763a8ee5f9c41b49bc12972b0355a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:47.329764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:47.425893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290922d-b105-4177-a3f9-fdcfdfe8eaa9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:47.426414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290922d-b105-4177-a3f9-fdcfdfe8eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:47.426615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290922d-b105-4177-a3f9-fdcfdfe8eaa9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:47.430488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 881/1771] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:46:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:47.559518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:47.560197 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:47.560758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:47.577046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:47.624727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:47.631706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:47.668901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 891/1772] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:47.742628 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:47.746495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:47.748844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:47.805669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 882/1773] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:46:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:47.919595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:47.921141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:47.943757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d3ba5-35bd-42af-9b48-31848bc6f146 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:47.968047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575cfca-eb15-4956-8450-884ec8702d04 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:47.973666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:47.976734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:47.977040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:47.977336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:47.982848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:47.983611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:47.984941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:47.985252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:48.008024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:48.010106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:48.012334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:48.016549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:48.044618 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 892/1774] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:48.048401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 883/1775] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:48.228230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:48.231296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:48.322585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:48.339751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c588-69eb-4b06-a81e-05ed2a56c243 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:48.365263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:48.368117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:48.373922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:48.374455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:48.570900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd75ad5-73fc-456b-a334-aad77561fa4a service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:48.590301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:48.593071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:48.593612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:48.594413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] PATH_INFO: `/v3/projects/0ed35b3b3b3040c289732acc4be1f4b4` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:48.597347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed35b3b3b3040c289732acc4be1f4b4)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:48.601853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:48.626035 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:48.632825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:48.660360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 884/1776] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:48.916979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed35b3b3b3040c289732acc4be1f4b4', 'request_id': 'req-f22761b9-a29c-470f-af82-350bd3f3a3d1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:48.975209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed35b3b3b3040c289732acc4be1f4b4', 'request_id': 'req-f22761b9-a29c-470f-af82-350bd3f3a3d1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:49.034322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed35b3b3b3040c289732acc4be1f4b4', 'request_id': 'req-f22761b9-a29c-470f-af82-350bd3f3a3d1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:49.196382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] The token cache is being invalidate because project 0ed35b3b3b3040c289732acc4be1f4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:49.196974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:49.208869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f22761b9-a29c-470f-af82-350bd3f3a3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:49.221736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 893/1777] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:48 2022] DELETE /identity/v3/projects/0ed35b3b3b3040c289732acc4be1f4b4 => generated 0 bytes in 990 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:46:49.224490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:49.264949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a544fd-40ce-4385-8307-50887e1d9872 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:49.593401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:49.594610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:49.595012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:49.595399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] PATH_INFO: `/v3/users/65b17e9b5b5b4904adc55638dbfb569f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:49.597101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b17e9b5b5b4904adc55638dbfb569f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:49.599539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:50.131692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b17e9b5b5b4904adc55638dbfb569f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:50.134546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b17e9b5b5b4904adc55638dbfb569f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:50.216766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b17e9b5b5b4904adc55638dbfb569f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:50.225879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:50.287437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b17e9b5b5b4904adc55638dbfb569f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:50.293714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b17e9b5b5b4904adc55638dbfb569f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:50.333565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2817c6b-91ec-4c59-b410-4f99ea100232 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:50.334365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2817c6b-91ec-4c59-b410-4f99ea100232 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:50.334874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2817c6b-91ec-4c59-b410-4f99ea100232 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:50.350960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 894/1778] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:46:50 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:46:50.433820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 885/1779] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:49 2022] DELETE /identity/v3/users/65b17e9b5b5b4904adc55638dbfb569f => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:50.467717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:50.468280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:50.468811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:50.508820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] MFA Rules not processed for user `bbbf155ccbb14c9b908a9077555feadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:50.512676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:50.589538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:50.756861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 895/1780] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:50.897903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:50.900021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:50.939100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:50.940749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:50.952843 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a517a4-5fa1-4355-bcbc-c6cd64b8953d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:50.987881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:50.989968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:50.990441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:50.991941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:51.068518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:51.077143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:51.186248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 886/1781] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:51.188813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f2d8-264b-4340-a043-35a7fe613fa1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:51.215017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:51.217787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:51.221519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:51.223589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] PATH_INFO: `/v3/users/b267bf0c935c42c9a57381025196cffa` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:51.230777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b267bf0c935c42c9a57381025196cffa)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:51.234333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:51.670509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b267bf0c935c42c9a57381025196cffa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:51.671825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b267bf0c935c42c9a57381025196cffa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:51.723990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b267bf0c935c42c9a57381025196cffa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:51.759635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b267bf0c935c42c9a57381025196cffa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:51.761977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7842a02e-2c49-4012-8fb3-53f3b02972c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b267bf0c935c42c9a57381025196cffa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:51.909854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 896/1782] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:50 2022] DELETE /identity/v3/users/b267bf0c935c42c9a57381025196cffa => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:52.231447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:52.239855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:52.380364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daa06d-7344-4b8d-a061-0978cfcca78f service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:52.702087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62d3a-ef43-4af8-8cde-c453f4a17fc7 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:52.703906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62d3a-ef43-4af8-8cde-c453f4a17fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:52.705509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62d3a-ef43-4af8-8cde-c453f4a17fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:52.755172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:52.758974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:52.762434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:52.763239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] PATH_INFO: `/v3/projects/cfbf8d6c6d0e41abbe7e00f60214e173` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:52.769869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfbf8d6c6d0e41abbe7e00f60214e173)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:52.780247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:52.982466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7fa62d3a-ef43-4af8-8cde-c453f4a17fc7 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:52.986126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7fa62d3a-ef43-4af8-8cde-c453f4a17fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:53.019105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:53.128708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfbf8d6c6d0e41abbe7e00f60214e173', 'request_id': 'req-539148bd-8dd3-460b-bbd0-e20d7d613213'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:53.191484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 897/1783] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:53.271471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfbf8d6c6d0e41abbe7e00f60214e173', 'request_id': 'req-539148bd-8dd3-460b-bbd0-e20d7d613213'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:53.296679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfbf8d6c6d0e41abbe7e00f60214e173', 'request_id': 'req-539148bd-8dd3-460b-bbd0-e20d7d613213'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:53.347954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] The token cache is being invalidate because project cfbf8d6c6d0e41abbe7e00f60214e173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:53.348275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:53.350462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-539148bd-8dd3-460b-bbd0-e20d7d613213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:53.354900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 887/1784] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:52 2022] DELETE /identity/v3/projects/cfbf8d6c6d0e41abbe7e00f60214e173 => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:53.362797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:53.363692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:53.365576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:53.432451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:53.441198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:53.774857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 898/1785] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:53.787182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f00d-29b7-4f0c-996e-756781b5ba1e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:53.787678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f00d-29b7-4f0c-996e-756781b5ba1e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:53.788113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f00d-29b7-4f0c-996e-756781b5ba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:53.830065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:53.831775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:53.834504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c299f00d-29b7-4f0c-996e-756781b5ba1e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:53.837389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c299f00d-29b7-4f0c-996e-756781b5ba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:53.925862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 888/1786] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:53.937281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f00d-29b7-4f0c-996e-756781b5ba1e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:54.012405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f00d-29b7-4f0c-996e-756781b5ba1e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:54.035839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:54.038609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:54.040357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:54.045560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:54.048808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:54.053498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:54.064860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:54.124430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 889/1787] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:54.142107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:54.151060 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb8a1a-52fc-41ce-b535-665693b08d89 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:54.162843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fd777-81e5-4af5-88cb-20d89b2eb84e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:54.164888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a65e9-9db1-4b88-942a-4c8c2b29794d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:54.179764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fd777-81e5-4af5-88cb-20d89b2eb84e service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:54.179764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fd777-81e5-4af5-88cb-20d89b2eb84e service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:54.179764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fd777-81e5-4af5-88cb-20d89b2eb84e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:54.186824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8c6fd777-81e5-4af5-88cb-20d89b2eb84e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:54.195714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:54.202054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:54.202685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:54.208446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:54.208446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:54.210637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:54.379961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:54.382228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 890/1788] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:54 2022] POST /identity/v3/projects => generated 367 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:54.389319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:54.497922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:54.657014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fd777-81e5-4af5-88cb-20d89b2eb84e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:54.675361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fd777-81e5-4af5-88cb-20d89b2eb84e service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:54.714707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 899/1789] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:46:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 885 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:46:54.719819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:54.719819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:54.719819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:54.769387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2acb15-176f-4766-ba22-1bc2191d3fbd admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:54.810638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:54.821653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:54.822649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:54.826592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:54.826592 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:54.827155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] MFA Rules not processed for user `e59b9b2fcf024b05a9d751a42713f012`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:54.827863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:54.829073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:54.926647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 900/1790] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:54.928096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:54.930043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:54.951905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b26048-c5da-4afe-bf23-d1d1446bb3ac None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:54.963841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:54.963841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:54.963841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:54.963841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] PATH_INFO: `/v3/projects/6f1cfae1a2ad4ede95950fc364bdd931` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:54.964968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1cfae1a2ad4ede95950fc364bdd931)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:54.966780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:55.005371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 891/1791] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:54 2022] POST /identity/v3/users => generated 284 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:55.013801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:55.065591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce392a-539c-4586-b9bb-d11d1dd9aa5f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:55.083313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:55.084552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:55.085046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:55.085953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:55.089654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:55.093209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:55.138044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 892/1792] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:55.141018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:55.176766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522c80-d525-41f3-bd9e-b8744d1ef01a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:55.192508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:55.192939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:55.193230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:55.193516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:55.194317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:55.196013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:55.265081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 893/1793] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:55.270198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:55.273459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1cfae1a2ad4ede95950fc364bdd931', 'request_id': 'req-73b4e026-7fab-4729-9b0d-32a79f1f0784'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:55.304240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1cfae1a2ad4ede95950fc364bdd931', 'request_id': 'req-73b4e026-7fab-4729-9b0d-32a79f1f0784'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:55.328935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed9c6e-c8e7-4fb0-bfb0-e811f198ec8b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:55.342059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1cfae1a2ad4ede95950fc364bdd931', 'request_id': 'req-73b4e026-7fab-4729-9b0d-32a79f1f0784'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:55.470682 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] The token cache is being invalidate because project 6f1cfae1a2ad4ede95950fc364bdd931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:55.472980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:55.472980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:55.476058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 901/1794] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:54 2022] DELETE /identity/v3/projects/6f1cfae1a2ad4ede95950fc364bdd931 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:55.484895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:55.491877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:55.608699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a9d1b-a26c-4f5e-9d39-a67751a441aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:55.610414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a9d1b-a26c-4f5e-9d39-a67751a441aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:55.612095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a9d1b-a26c-4f5e-9d39-a67751a441aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:55.625410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a9d1b-a26c-4f5e-9d39-a67751a441aa admin admin] PATH_INFO: `/v3/projects/838e756570f047ff8df5dfd84a1bb976/users/6c6028bbd0b84765bbae747952e1383b/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:55.678818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a9d1b-a26c-4f5e-9d39-a67751a441aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=838e756570f047ff8df5dfd84a1bb976, user_id=6c6028bbd0b84765bbae747952e1383b, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:55.687286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a9d1b-a26c-4f5e-9d39-a67751a441aa admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:55.719559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4e026-7fab-4729-9b0d-32a79f1f0784 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:55.726963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:55.729640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:55.730936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:55.731419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] PATH_INFO: `/v3/users/dd65cca4e6cd4123bd47863eaf69f94a` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:55.733483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd65cca4e6cd4123bd47863eaf69f94a)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:55.736475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:55.750032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:55.800913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 894/1795] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:55 2022] PUT /identity/v3/projects/838e756570f047ff8df5dfd84a1bb976/users/6c6028bbd0b84765bbae747952e1383b/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:55.824627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:55.825223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:55.825952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:55.915539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] MFA Rules not processed for user `6c6028bbd0b84765bbae747952e1383b`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:55.917773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:56.063688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd65cca4e6cd4123bd47863eaf69f94a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:56.065182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd65cca4e6cd4123bd47863eaf69f94a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:56.110247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd65cca4e6cd4123bd47863eaf69f94a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:56.137244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd65cca4e6cd4123bd47863eaf69f94a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:56.139197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd65cca4e6cd4123bd47863eaf69f94a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:56.139351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:56.149485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 895/1796] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:46:56.158479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:56.162548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:56.348413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efa41b-1578-4cac-b23b-e8f7b9e18149 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:56.353160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 902/1797] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:55 2022] DELETE /identity/v3/users/dd65cca4e6cd4123bd47863eaf69f94a => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:56.656969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:56.657966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:56.658214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:56.658498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:56.659296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:56.672926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:57.232119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:57.234923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:57.238150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 896/1798] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:56 2022] POST /identity/v3/projects => generated 367 bytes in 1082 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:57.243063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:57.264744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf04a-82d0-4a94-9b9c-57be5518877f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:57.388902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:57.396609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:57.396609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:57.396609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] PATH_INFO: `/v3/projects/6a6bfb735e304c409286389de06d725c` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:57.397221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ced186-2fe6-493d-9cf8-f17661c540a8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:57.397393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6bfb735e304c409286389de06d725c)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:57.398587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:57.407385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:57.408128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:57.408424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:57.408761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:57.409666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:57.412092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:57.591442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 897/1799] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:57 2022] POST /identity/v3/users => generated 290 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:57.598716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:57.619439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87441b8a-8525-4bd0-a133-7ab5ffae946e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:57.633664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:57.636555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:57.637734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:57.639168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:57.642802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:57.648181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:57.668996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 898/1800] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:57.677283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:57.682308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6bfb735e304c409286389de06d725c', 'request_id': 'req-f0accd68-2903-499d-b487-fd006d8cb602'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:57.696496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6bfb735e304c409286389de06d725c', 'request_id': 'req-f0accd68-2903-499d-b487-fd006d8cb602'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:57.697074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d63f7-0e7c-401a-ac0d-45b1438f441f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:57.708898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6bfb735e304c409286389de06d725c', 'request_id': 'req-f0accd68-2903-499d-b487-fd006d8cb602'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:57.716744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:57.809718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:57.810789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:57.811221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:57.811566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] PATH_INFO: `/v3/projects/c44983d93d0440638ed1cf6576269644/users/3271b0a9d5434b678ff2fa4797803072/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:57.817754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] The token cache is being invalidate because project 6a6bfb735e304c409286389de06d725c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:46:57.818031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:57.820942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0accd68-2903-499d-b487-fd006d8cb602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:46:57.835117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44983d93d0440638ed1cf6576269644, user_id=3271b0a9d5434b678ff2fa4797803072, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:57.840106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:57.846204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 903/1801] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:46:57 2022] DELETE /identity/v3/projects/6a6bfb735e304c409286389de06d725c => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:46:57.851462 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1a20-9d7c-4d13-9481-61484d76408c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:57.851857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1a20-9d7c-4d13-9481-61484d76408c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:57.852513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1a20-9d7c-4d13-9481-61484d76408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:57.939082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-484e1a20-9d7c-4d13-9481-61484d76408c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:57.940401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-484e1a20-9d7c-4d13-9481-61484d76408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:57.955216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 899/1802] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:57 2022] PUT /identity/v3/projects/c44983d93d0440638ed1cf6576269644/users/3271b0a9d5434b678ff2fa4797803072/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:57.956949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:57.961453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:57.968659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:58.252182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 904/1803] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:58.261974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf8fd-771d-41c1-8ff8-de501d79d1a8 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:58.262877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf8fd-771d-41c1-8ff8-de501d79d1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:58.263515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf8fd-771d-41c1-8ff8-de501d79d1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:58.307097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e2acf8fd-771d-41c1-8ff8-de501d79d1a8 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:58.310330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e2acf8fd-771d-41c1-8ff8-de501d79d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:58.340093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 905/1804] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:46:58.343386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46999f41-4868-49d2-ad5c-5d4ab046f352 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:58.350579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf8fd-771d-41c1-8ff8-de501d79d1a8 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:58.371828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf8fd-771d-41c1-8ff8-de501d79d1a8 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:58.376670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:58.392958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:58.393144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:58.393321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:58.393321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:58.393616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:58.393803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:58.393803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:46:58.393803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:58.394193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:58.394352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:58.395012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:58.418296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:58.445651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 900/1805] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:46:58.464128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 906/1806] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:46:58.468146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:58.477496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:58.498257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd0f1a-c09d-4837-ac81-1c2a5b42cfe2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:58.510479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:58.512079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:58.512500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:58.513793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:58.515955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:58.524252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70036f-791f-4ecb-af9b-eb29148f9dfd admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:58.524488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:58.534403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c544ec8-097d-4de4-887b-39e022886a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:58.536965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544ec8-097d-4de4-887b-39e022886a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:58.537364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544ec8-097d-4de4-887b-39e022886a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:58.537754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544ec8-097d-4de4-887b-39e022886a52 admin admin] PATH_INFO: `/v3/projects/c44983d93d0440638ed1cf6576269644/users/3271b0a9d5434b678ff2fa4797803072/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:58.549801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c544ec8-097d-4de4-887b-39e022886a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44983d93d0440638ed1cf6576269644, user_id=3271b0a9d5434b678ff2fa4797803072, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:58.558218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c544ec8-097d-4de4-887b-39e022886a52 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:58.588776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 901/1807] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:58 2022] PUT /identity/v3/projects/c44983d93d0440638ed1cf6576269644/users/3271b0a9d5434b678ff2fa4797803072/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:46:58.607811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:58.608164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:58.608525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:58.653087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] MFA Rules not processed for user `3271b0a9d5434b678ff2fa4797803072`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:46:58.655173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:58.767352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 907/1808] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:46:58 2022] POST /identity/v3/projects => generated 373 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:46:58.773845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:58.865951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 902/1809] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:46:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:46:58.883455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:58.887576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:58.899290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:58.962116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d884e65-48b5-4aef-90f3-83c5474f637b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:58.966146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:58.966927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:58.967219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:58.967505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:58.968245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:58.971064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:59.094002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333040-4cf6-4a06-8850-99b42dd6a0fe None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:59.152888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 908/1810] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:46:58 2022] POST /identity/v3/users => generated 287 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:46:59.157416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:59.241991 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363b8d-47ed-40e5-b156-b003b523a452 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:59.279732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:59.280799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:59.280799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:59.281270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:59.293977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:59.297081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:59.345660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:59.346848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:59.347601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:59.381349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:59.404440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 909/1811] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:59.430832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:59.471923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71568-2668-45d5-97ec-b5e52a90d1d7 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:59.503151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:59.536996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:59.537536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:59.538033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:59.539386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:59.561752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:59.689296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 910/1812] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:46:59.692239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:59.738871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:46:59.797897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:59.799292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:59.826307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6047092-9f8d-4c35-b2d0-1ab85d801b01 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:59.857871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 903/1813] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:46:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 975 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:46:59.858661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:59.859015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:46:59.863236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:59.863742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:59.895625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] PATH_INFO: `/v3/users/fa1b4789239947c08fc67ecb2f7696e2` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:46:59.901104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1b4789239947c08fc67ecb2f7696e2)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:46:59.905665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736439-b03d-402a-a6ea-bf05751abe99 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:46:59.922043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:46:59.934147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d08cc-f47b-4a91-a392-d87411d2dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:46:59.938304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d08cc-f47b-4a91-a392-d87411d2dda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:46:59.939210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d08cc-f47b-4a91-a392-d87411d2dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:46:59.977998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d08cc-f47b-4a91-a392-d87411d2dda1 admin admin] PATH_INFO: `/v3/projects/7fbd1fa117d148659b743c9c3bd4f65e/users/15192fcc0e02436b90c73fdc284b2e71/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:00.081139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d08cc-f47b-4a91-a392-d87411d2dda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbd1fa117d148659b743c9c3bd4f65e, user_id=15192fcc0e02436b90c73fdc284b2e71, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:00.085629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d08cc-f47b-4a91-a392-d87411d2dda1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:00.256531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 904/1814] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:46:59 2022] PUT /identity/v3/projects/7fbd1fa117d148659b743c9c3bd4f65e/users/15192fcc0e02436b90c73fdc284b2e71/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:00.259800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec7d29-4c1b-42dd-823b-86cfd4c09b95 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:00.263152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec7d29-4c1b-42dd-823b-86cfd4c09b95 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:00.264581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec7d29-4c1b-42dd-823b-86cfd4c09b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:00.347529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:00.364229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-eaec7d29-4c1b-42dd-823b-86cfd4c09b95 None None] MFA Rules not processed for user `b40cb94150444c81ab1de3c6c1c1ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:00.370015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eaec7d29-4c1b-42dd-823b-86cfd4c09b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:00.392029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1b4789239947c08fc67ecb2f7696e2'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:00.394922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1b4789239947c08fc67ecb2f7696e2'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:00.454698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1b4789239947c08fc67ecb2f7696e2'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:00.480999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1b4789239947c08fc67ecb2f7696e2'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:00.494277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5f656ee9-6eba-48b7-993f-cdec33cf9bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1b4789239947c08fc67ecb2f7696e2'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:00.583195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:00.599776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 911/1815] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:46:59 2022] DELETE /identity/v3/users/fa1b4789239947c08fc67ecb2f7696e2 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:00.604370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:00.608150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:00.609860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:00.639121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 905/1816] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Jul 18 08:47:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:00.640625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:00.643390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:00.643936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:00.722541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:00.725881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:00.773627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] MFA Rules not processed for user `15192fcc0e02436b90c73fdc284b2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:00.798107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:00.912770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 906/1817] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:00.913931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:00.918285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:01.017931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 912/1818] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:01.017931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:01.017931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:01.053426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f253a-cc47-494b-ba10-7af97318df73 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:01.059543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:01.060393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:01.061744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:01.065706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:01.099463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:01.108788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:01.114231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8db7e-6f84-4b3a-bd3b-4b654c4d1725 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:01.120430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:01.121588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:01.122118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:01.122478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:01.134793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:01.143718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 907/1819] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:01.144686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:01.145310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:01.158948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd43500-3b46-4a3f-ad4b-60fa3ff76034 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:01.186195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:01.189986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:01.192931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:01.192931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:01.207385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 913/1820] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:01.211498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:01.212938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:01.216179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:01.239983 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 908/1821] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:01.242677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:01.242856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2be267-d000-4cbd-90f4-e33d3b5e7d13 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:01.257147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:01.257147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:01.257147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:01.257147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:01.289291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:01.294864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:01.296774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b5d8-4432-4762-a873-f7739d6f7b20 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:01.313792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:01.314985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 914/1822] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:01.317550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:01.319529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:01.319651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:01.322573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:01.324280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:01.358272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:01.359595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2882115-6dee-49f5-ae48-2b8796e9f81b service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:01.364443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:01.380438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:01.385578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:01.388476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:01.396799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:01.396799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:01.397028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 909/1823] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:01.397107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:01.573621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 915/1824] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:01 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:01.579249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:01.594060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61840-4aea-4bc5-b630-0c93fea6707b service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:01.828602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:01.831586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:01.831884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:01.832222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:01.832985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:01.836544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:02.006869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 910/1825] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:01 2022] POST /identity/v3/users => generated 293 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:02.009137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:02.029358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9b91-c421-407f-981e-c1fd86bc0b19 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:02.043797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:02.044634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:02.044922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:02.045281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:02.046128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:02.048012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:02.089005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 916/1826] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:02.093484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:02.108095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b1d-1542-4ab6-8e84-086245e95a07 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:02.114798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:02.116085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:02.116566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:02.117039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] PATH_INFO: `/v3/projects/b847a5700d4846ab9c0c9c472f93f630/users/564aa4dcdf7e44288afa721889450fe9/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:02.140626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b847a5700d4846ab9c0c9c472f93f630, user_id=564aa4dcdf7e44288afa721889450fe9, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:02.147924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:02.237797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 911/1827] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:02 2022] PUT /identity/v3/projects/b847a5700d4846ab9c0c9c472f93f630/users/564aa4dcdf7e44288afa721889450fe9/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:02.238074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:02.254641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f9908-38b9-4d23-9824-c3628447f9f5 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:02.401332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:02.489513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16412319-2c14-450d-ba7d-495774976889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:02.491210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16412319-2c14-450d-ba7d-495774976889 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:02.493133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16412319-2c14-450d-ba7d-495774976889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:02.493803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16412319-2c14-450d-ba7d-495774976889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:02.498084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16412319-2c14-450d-ba7d-495774976889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:02.503735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16412319-2c14-450d-ba7d-495774976889 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:02.555709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 917/1828] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:02.560297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:02.596778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89e41c-ac81-4479-b862-2a58750016ed admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:02.604356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:02.606789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:02.607450 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:02.608119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] PATH_INFO: `/v3/projects/b847a5700d4846ab9c0c9c472f93f630/users/564aa4dcdf7e44288afa721889450fe9/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:02.613004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b847a5700d4846ab9c0c9c472f93f630, user_id=564aa4dcdf7e44288afa721889450fe9, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:02.625726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:02.662818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 912/1829] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:02 2022] PUT /identity/v3/projects/b847a5700d4846ab9c0c9c472f93f630/users/564aa4dcdf7e44288afa721889450fe9/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:02.668281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:02.668919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:02.669485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:02.737214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] MFA Rules not processed for user `564aa4dcdf7e44288afa721889450fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:02.740584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:02.971362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:02.971362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:02.989231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 918/1830] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:03.001049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:03.006454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:03.021718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:03.253144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68075fba-c709-4585-a5cb-fe45ddce1de8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:03.257967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:03.258890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:03.259177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:03.259454 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] PATH_INFO: `/v3/projects/5f5da843ecc14791993a6abcfd52128e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:03.261480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5da843ecc14791993a6abcfd52128e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:03.264744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:03.373257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210c4ec-bf26-4af8-9f94-99cbb8e90222 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:03.411274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:03.412237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:03.412815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:03.413363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:03.458916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:03.460891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:03.482945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5da843ecc14791993a6abcfd52128e', 'request_id': 'req-3a7d4932-a5a4-4c11-a288-c56ae3308955'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:03.510426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 919/1831] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:03.566488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5da843ecc14791993a6abcfd52128e', 'request_id': 'req-3a7d4932-a5a4-4c11-a288-c56ae3308955'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:03.577271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5da843ecc14791993a6abcfd52128e', 'request_id': 'req-3a7d4932-a5a4-4c11-a288-c56ae3308955'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:03.592785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] The token cache is being invalidate because project 5f5da843ecc14791993a6abcfd52128e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:03.593224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:03.594917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:03.597585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 913/1832] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:02 2022] DELETE /identity/v3/projects/5f5da843ecc14791993a6abcfd52128e => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:03.606319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:03.669165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a478c61-22ec-461b-8b96-18f0efbbfc3d service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:03.832733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:03.847537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:03.848254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:03.848688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] PATH_INFO: `/v3/users/c763a8ee5f9c41b49bc12972b0355a8e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:03.849246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:03.850684 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c763a8ee5f9c41b49bc12972b0355a8e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:03.851678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:03.853036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:04.007710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4932-a5a4-4c11-a288-c56ae3308955 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:04.012866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b32f-a379-4a1d-8a6f-b190823db760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:04.013647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b32f-a379-4a1d-8a6f-b190823db760 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:04.014159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b32f-a379-4a1d-8a6f-b190823db760 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:04.014621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b32f-a379-4a1d-8a6f-b190823db760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:04.025297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9a48b32f-a379-4a1d-8a6f-b190823db760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:04.039717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:04.166194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c763a8ee5f9c41b49bc12972b0355a8e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:04.208261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c763a8ee5f9c41b49bc12972b0355a8e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:04.238182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b32f-a379-4a1d-8a6f-b190823db760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:04.240387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b32f-a379-4a1d-8a6f-b190823db760 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:04.271356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 914/1833] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:04.274200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c763a8ee5f9c41b49bc12972b0355a8e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:04.283080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03721-994f-40cc-8ee0-e27631612fc7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:04.287505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03721-994f-40cc-8ee0-e27631612fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:04.287835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03721-994f-40cc-8ee0-e27631612fc7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:04.308279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 915/1834] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:47:04 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:47:04.320940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:04.320940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:04.334765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:04.345577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c763a8ee5f9c41b49bc12972b0355a8e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:04.345814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c763a8ee5f9c41b49bc12972b0355a8e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:04.375193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:04.377879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:04.438179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 920/1835] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:03 2022] DELETE /identity/v3/users/c763a8ee5f9c41b49bc12972b0355a8e => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:04.569444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 916/1836] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:47:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:04.804165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:04.880393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:04.883687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:05.176360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774da5a-cc4f-4aa1-9019-0dee0fa4f316 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:05.201882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6016-6900-4b28-b6f7-d3f156f5263b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:05.202660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6016-6900-4b28-b6f7-d3f156f5263b service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:05.202958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6016-6900-4b28-b6f7-d3f156f5263b service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:05.203246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6016-6900-4b28-b6f7-d3f156f5263b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:05.231574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6016-6900-4b28-b6f7-d3f156f5263b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:05.233423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6016-6900-4b28-b6f7-d3f156f5263b service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:05.278538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 921/1837] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:05.376899 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:05.383072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:05.421150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1020e3-99ba-41c6-9f85-8c33c72f852a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:05.597887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:05.599479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:05.600024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:05.600515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] PATH_INFO: `/v3/users/2d0cd750c4274aa6bf4c9ae7202bc7c2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:05.602670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0cd750c4274aa6bf4c9ae7202bc7c2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:05.605841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:05.902089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:05.969405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0cd750c4274aa6bf4c9ae7202bc7c2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:05.971798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0cd750c4274aa6bf4c9ae7202bc7c2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:06.024083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0cd750c4274aa6bf4c9ae7202bc7c2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:06.038647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0cd750c4274aa6bf4c9ae7202bc7c2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:06.039776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0cd750c4274aa6bf4c9ae7202bc7c2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:06.163944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 917/1838] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:05 2022] DELETE /identity/v3/users/2d0cd750c4274aa6bf4c9ae7202bc7c2 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:06.172676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:06.173238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:06.173843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:06.223492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:06.230456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:06.336010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:06.489784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 922/1839] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:06.606779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:06.608422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:06.771582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ee257-f3f7-429d-b726-7f23ffd648b2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:06.787734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:06.788437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:06.788731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:06.789020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:06.789254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:06.791228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:06.807244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:06.809564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:06.813349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e02901-3dd6-4647-97c5-1ea558994fba None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:06.828734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:06.829741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:06.830099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:06.830447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] PATH_INFO: `/v3/users/6c6028bbd0b84765bbae747952e1383b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:06.833503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 918/1840] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:06.834586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6028bbd0b84765bbae747952e1383b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:06.836935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:07.040778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:07.045114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:07.106586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02ed54-6c68-4153-be1d-1a81c43c76e6 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:07.132672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:07.134745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:07.135508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:07.138703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] PATH_INFO: `/v3/projects/4e16a12aff4e4cc89fd99d9fd53e3ceb` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:07.143555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e16a12aff4e4cc89fd99d9fd53e3ceb)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:07.154741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:07.223806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6028bbd0b84765bbae747952e1383b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.226703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6028bbd0b84765bbae747952e1383b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.278450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6028bbd0b84765bbae747952e1383b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.288283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6028bbd0b84765bbae747952e1383b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.294463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-39952426-dd08-4333-b01f-cfd64bcfc6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6028bbd0b84765bbae747952e1383b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.391070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 923/1841] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:06 2022] DELETE /identity/v3/users/6c6028bbd0b84765bbae747952e1383b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:07.400081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f5b55-eb11-45db-b89f-b3e4b6983fa2 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:07.400659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f5b55-eb11-45db-b89f-b3e4b6983fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:07.401096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f5b55-eb11-45db-b89f-b3e4b6983fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:07.419378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e16a12aff4e4cc89fd99d9fd53e3ceb', 'request_id': 'req-0287f39d-8981-4400-907d-934cd9a834a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.478234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7f7f5b55-eb11-45db-b89f-b3e4b6983fa2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:07.480004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7f7f5b55-eb11-45db-b89f-b3e4b6983fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:07.526831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e16a12aff4e4cc89fd99d9fd53e3ceb', 'request_id': 'req-0287f39d-8981-4400-907d-934cd9a834a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.541549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e16a12aff4e4cc89fd99d9fd53e3ceb', 'request_id': 'req-0287f39d-8981-4400-907d-934cd9a834a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.617179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] The token cache is being invalidate because project 4e16a12aff4e4cc89fd99d9fd53e3ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:07.618677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.621407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0287f39d-8981-4400-907d-934cd9a834a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:07.623473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 919/1842] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:07 2022] DELETE /identity/v3/projects/4e16a12aff4e4cc89fd99d9fd53e3ceb => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:07.630073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aa00f-7664-48d0-9fbd-d31969ea0fc9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:07.630941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aa00f-7664-48d0-9fbd-d31969ea0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:07.631855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aa00f-7664-48d0-9fbd-d31969ea0fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:07.649835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 924/1843] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:07.669437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e14aa00f-7664-48d0-9fbd-d31969ea0fc9 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:07.679241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e14aa00f-7664-48d0-9fbd-d31969ea0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:07.700264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 920/1844] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:07.703503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace73a8-51b0-4968-8b88-70ddfac76a23 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:07.703741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace73a8-51b0-4968-8b88-70ddfac76a23 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:07.704354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace73a8-51b0-4968-8b88-70ddfac76a23 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:07.706332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 925/1845] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:47:07.715948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4158-43ef-4116-b2ab-9b4050c49849 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:07.715948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4158-43ef-4116-b2ab-9b4050c49849 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:07.715948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4158-43ef-4116-b2ab-9b4050c49849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:07.744439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace73a8-51b0-4968-8b88-70ddfac76a23 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:07.747166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0ace73a8-51b0-4968-8b88-70ddfac76a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:07.766576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-197e4158-43ef-4116-b2ab-9b4050c49849 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:07.768327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-197e4158-43ef-4116-b2ab-9b4050c49849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:07.778771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 921/1846] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:07.781621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf1b2-6458-4ecf-822d-11a1685bfc50 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:07.782390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf1b2-6458-4ecf-822d-11a1685bfc50 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:07.783034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbf1b2-6458-4ecf-822d-11a1685bfc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:07.809321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c5cbf1b2-6458-4ecf-822d-11a1685bfc50 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:07.813955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c5cbf1b2-6458-4ecf-822d-11a1685bfc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:07.874828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:07.965869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 922/1847] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:07.971109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbf1b2-6458-4ecf-822d-11a1685bfc50 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:08.005634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbf1b2-6458-4ecf-822d-11a1685bfc50 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:08.021574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:08.022751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:08.023198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:08.023656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:08.024954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:08.027066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:08.029896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:08.034937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace73a8-51b0-4968-8b88-70ddfac76a23 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:08.050856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:08.051616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:08.052017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:08.052299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:08.056102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:08.065729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 923/1848] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:08.072251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:08.087064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:08.088572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:08.096488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad05f6-10e1-4168-ae9d-9e8c25be9b3e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:08.111749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:08.112487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:08.112780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:08.113073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:08.113830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:08.116037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:08.119509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 926/1849] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:08.145062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:08.271009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 924/1850] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:08 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:08.276786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:08.295366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7103-8841-4e93-8272-198fc50e603a service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:08.424356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:08.429112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:08.485973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:08.485973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:08.485973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:08.485973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:08.488131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:08.492201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:08.640929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 927/1851] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:08 2022] POST /identity/v3/users => generated 294 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:08.642351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:08.646733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:08.709082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c7e9-b35e-41bb-a2a2-b4e3482bdaad admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:08.734780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:08.735611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:08.742588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:08.742909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] PATH_INFO: `/v3/projects/4fd1a0bb3dcb4065aaeb0a07258b3bda` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:08.743561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d8e2-0e0d-480a-9e9e-3e770bab2434 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:08.748667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd1a0bb3dcb4065aaeb0a07258b3bda)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:08.751817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:08.779448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:08.784417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:08.788472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:08.793838 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:08.822686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:08.822686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:08.880336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 925/1852] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:47:08.881519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:08.908241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d367-2e66-4e23-8b9c-eeba01cb745d service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:08.928032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:08.928755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:08.929031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:08.930194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:08.930304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:08.932329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:08.966050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 926/1853] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:08.968447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:08.996914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08601035-689c-48be-a299-d8e1e19cd902 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:09.030346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd1a0bb3dcb4065aaeb0a07258b3bda', 'request_id': 'req-413d5e26-5174-4a5a-812c-1704e89f83c3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.056431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd1a0bb3dcb4065aaeb0a07258b3bda', 'request_id': 'req-413d5e26-5174-4a5a-812c-1704e89f83c3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.075679 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd1a0bb3dcb4065aaeb0a07258b3bda', 'request_id': 'req-413d5e26-5174-4a5a-812c-1704e89f83c3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.129118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:09.131956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:09.132342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:09.132698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:09.133632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:09.141458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:09.181990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 927/1854] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:09.183387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:09.213309 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ced7-cd3d-4a7c-bba8-10e94fe9edab admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:09.232353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b78f7-b7e4-4732-853f-a5be56392037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:09.232692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b78f7-b7e4-4732-853f-a5be56392037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:09.235046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b78f7-b7e4-4732-853f-a5be56392037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:09.235408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b78f7-b7e4-4732-853f-a5be56392037 admin admin] PATH_INFO: `/v3/projects/22c86b748e0d4e50bc6a5364a2f9fd49/users/260b26b1ed704295aa48a5b1048478d4/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:09.236006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] The token cache is being invalidate because project 4fd1a0bb3dcb4065aaeb0a07258b3bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:09.236581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.239410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.271445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 928/1855] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:08 2022] DELETE /identity/v3/projects/4fd1a0bb3dcb4065aaeb0a07258b3bda => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:09.277424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:09.281118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:09.292629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b78f7-b7e4-4732-853f-a5be56392037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c86b748e0d4e50bc6a5364a2f9fd49, user_id=260b26b1ed704295aa48a5b1048478d4, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:09.302248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b78f7-b7e4-4732-853f-a5be56392037 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:09.315129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5e26-5174-4a5a-812c-1704e89f83c3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:09.329803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:09.332115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:09.332460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:09.332852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] PATH_INFO: `/v3/users/ea0b9fa0c6ac44f497b43b2f497ce56b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:09.337148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0b9fa0c6ac44f497b43b2f497ce56b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:09.344496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:09.349939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:09.394647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 928/1856] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:09 2022] PUT /identity/v3/projects/22c86b748e0d4e50bc6a5364a2f9fd49/users/260b26b1ed704295aa48a5b1048478d4/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:09.412231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:09.412520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:09.412848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:09.478803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] MFA Rules not processed for user `260b26b1ed704295aa48a5b1048478d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:09.481503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:09.685726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 929/1857] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:09.691760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0b9fa0c6ac44f497b43b2f497ce56b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.691960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:09.692830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:09.702996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0b9fa0c6ac44f497b43b2f497ce56b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.709022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:09.739083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0b9fa0c6ac44f497b43b2f497ce56b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.766372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0b9fa0c6ac44f497b43b2f497ce56b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.768652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0b9fa0c6ac44f497b43b2f497ce56b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:09.882224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 929/1858] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:09 2022] DELETE /identity/v3/users/ea0b9fa0c6ac44f497b43b2f497ce56b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:09.912737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d07b79-fc3e-4591-894f-9405f54a0daa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:10.107590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:10.110555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:10.113271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:10.115458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:10.119100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:10.124513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:10.176800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:10.285440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 930/1859] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:09 2022] POST /identity/v3/projects => generated 385 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:10.285874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:10.288133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:10.316868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c9d7-6472-4e6a-925b-39e94bc2b865 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:10.508941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:10.512821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:10.517195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:10.518436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:10.523170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:10.534440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:10.688585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 930/1860] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:10 2022] POST /identity/v3/users => generated 299 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:10.693312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:10.711323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346949a-3060-471a-b795-1b694b95d946 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:10.719551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:10.720560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:10.720876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:10.721165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:10.722022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:10.723762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:10.780598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 931/1861] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:10.785157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:10.797189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc0020-e2cd-4f5b-a928-c087fbc258e0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:10.803722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:10.805119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:10.806430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:10.806430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] PATH_INFO: `/v3/projects/d8c1506ad1bb4d96bff34a57230706dd/users/d4696cdebb3f4aca9f3cc9cd709f8145/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:10.834830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c1506ad1bb4d96bff34a57230706dd, user_id=d4696cdebb3f4aca9f3cc9cd709f8145, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:10.837940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:10.988238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 931/1862] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:10 2022] PUT /identity/v3/projects/d8c1506ad1bb4d96bff34a57230706dd/users/d4696cdebb3f4aca9f3cc9cd709f8145/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:10.992462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:11.006687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43da8e3-6e75-4287-9822-2219a6fa4215 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:11.252342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772992f2-c59b-4a19-976e-fda97e2dd872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:11.253001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772992f2-c59b-4a19-976e-fda97e2dd872 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:11.253291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772992f2-c59b-4a19-976e-fda97e2dd872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:11.253568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772992f2-c59b-4a19-976e-fda97e2dd872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:11.254402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772992f2-c59b-4a19-976e-fda97e2dd872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:11.258823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772992f2-c59b-4a19-976e-fda97e2dd872 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:11.306484 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:11.307393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 932/1863] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:11.321243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e0c6-ea90-48cb-8da9-58298bd4b1a0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:11.345171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:11.345171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:11.345171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:11.345171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] PATH_INFO: `/v3/projects/d8c1506ad1bb4d96bff34a57230706dd/users/d4696cdebb3f4aca9f3cc9cd709f8145/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:11.347022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c1506ad1bb4d96bff34a57230706dd, user_id=d4696cdebb3f4aca9f3cc9cd709f8145, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:11.350364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:11.407052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 932/1864] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:11 2022] PUT /identity/v3/projects/d8c1506ad1bb4d96bff34a57230706dd/users/d4696cdebb3f4aca9f3cc9cd709f8145/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:11.411533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:11.411533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:11.411829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:11.473872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] MFA Rules not processed for user `d4696cdebb3f4aca9f3cc9cd709f8145`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:11.476643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:11.647348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 933/1865] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:11.662886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:11.666513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:11.869429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073662c8-6cee-4ae5-8351-07fcecc57d2b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:11.879492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:11.881636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:11.889018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:11.889018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:11.909368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:11.915175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:11.923194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:11.923194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:11.942236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 933/1866] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:12.147373 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:12.152267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:12.215304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83a5cb-5df9-4928-896d-b3bd3654d489 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:12.238067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:12.239533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:12.239939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:12.240376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] PATH_INFO: `/v3/projects/838e756570f047ff8df5dfd84a1bb976` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:12.251873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01a06c-a008-4f83-914e-9e80fbeb6cf0 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:12.255603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838e756570f047ff8df5dfd84a1bb976)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:12.259740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:12.271413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:12.272273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:12.272882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:12.273186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] PATH_INFO: `/v3/projects/715277ae22f341e295c0d70209491bd5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:12.277824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] RBAC: Authorizing `identity:delete_project(project_id=715277ae22f341e295c0d70209491bd5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:12.282177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:12.301330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:12.308701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:12.447560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838e756570f047ff8df5dfd84a1bb976', 'request_id': 'req-809d091b-bbb0-484d-9da1-ef3efc6d97e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.450163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715277ae22f341e295c0d70209491bd5', 'request_id': 'req-4eac5103-527f-48fc-a3f9-a0bbf371c42b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.456976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715277ae22f341e295c0d70209491bd5', 'request_id': 'req-4eac5103-527f-48fc-a3f9-a0bbf371c42b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.464981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715277ae22f341e295c0d70209491bd5', 'request_id': 'req-4eac5103-527f-48fc-a3f9-a0bbf371c42b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.555616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838e756570f047ff8df5dfd84a1bb976', 'request_id': 'req-809d091b-bbb0-484d-9da1-ef3efc6d97e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.563746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838e756570f047ff8df5dfd84a1bb976', 'request_id': 'req-809d091b-bbb0-484d-9da1-ef3efc6d97e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.578405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] The token cache is being invalidate because project 838e756570f047ff8df5dfd84a1bb976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:12.578405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.579232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:12.581000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 934/1867] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:11 2022] DELETE /identity/v3/projects/838e756570f047ff8df5dfd84a1bb976 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:12.581860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:12.583390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:12.665140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d091b-bbb0-484d-9da1-ef3efc6d97e4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:12.777516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:12.777516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:12.777516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:12.777516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] PATH_INFO: `/v3/users/260b26b1ed704295aa48a5b1048478d4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:12.778190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=260b26b1ed704295aa48a5b1048478d4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:12.778190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:13.768852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] The token cache is being invalidate because project 715277ae22f341e295c0d70209491bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:13.769470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:13.770075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:13.771623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 934/1868] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:12 2022] DELETE /identity/v3/projects/715277ae22f341e295c0d70209491bd5 => generated 0 bytes in 1630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:13.775210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:13.777921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:13.800960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac5103-527f-48fc-a3f9-a0bbf371c42b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:13.811412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:13.812578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:13.812995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:13.813343 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] PATH_INFO: `/v3/users/3271b0a9d5434b678ff2fa4797803072` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:13.815102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3271b0a9d5434b678ff2fa4797803072)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:13.818451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:13.941735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260b26b1ed704295aa48a5b1048478d4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:13.942944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260b26b1ed704295aa48a5b1048478d4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:13.962307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260b26b1ed704295aa48a5b1048478d4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:13.975683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260b26b1ed704295aa48a5b1048478d4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:13.975683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31d3604e-d19c-4155-a2a9-ec70d0b165bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260b26b1ed704295aa48a5b1048478d4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:14.141364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 935/1869] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:12 2022] DELETE /identity/v3/users/260b26b1ed704295aa48a5b1048478d4 => generated 0 bytes in 1560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:14.147147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe0e7a-bf25-4ec6-9b96-b63e3140ff11 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.147959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe0e7a-bf25-4ec6-9b96-b63e3140ff11 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.148507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe0e7a-bf25-4ec6-9b96-b63e3140ff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.177541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f6fe0e7a-bf25-4ec6-9b96-b63e3140ff11 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:14.179108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6fe0e7a-bf25-4ec6-9b96-b63e3140ff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:14.211311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3271b0a9d5434b678ff2fa4797803072'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:14.212015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3271b0a9d5434b678ff2fa4797803072'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:14.228003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3271b0a9d5434b678ff2fa4797803072'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:14.238097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3271b0a9d5434b678ff2fa4797803072'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:14.239032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3271b0a9d5434b678ff2fa4797803072'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:14.260417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 936/1870] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:14.261938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bce34-cf0e-47bc-88d6-a21a6d021c02 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.263566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bce34-cf0e-47bc-88d6-a21a6d021c02 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.263566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bce34-cf0e-47bc-88d6-a21a6d021c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.289602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b78bce34-cf0e-47bc-88d6-a21a6d021c02 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:14.290799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b78bce34-cf0e-47bc-88d6-a21a6d021c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:14.299785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 937/1871] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:14.301178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.301471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.301804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.321360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:14.322655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:14.331831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 938/1872] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:14.332674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:14.335795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 935/1873] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:13 2022] DELETE /identity/v3/users/3271b0a9d5434b678ff2fa4797803072 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:14.335928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:14.348998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:14.357275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:14.406273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3119ad-1c34-476c-b894-9bb383e35643 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:14.435529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0658df-cd44-4486-a45d-f1a5928efd69 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:14.443906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:14.444763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.445061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.445344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.446158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:14.446985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:14.448514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:14.465605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 936/1874] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:14.471195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:14.482574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:14.483711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.484171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.484619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.487729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091ccfa-7976-46af-97dc-faece2f5f09c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:14.492844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:14.493522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.493938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.494223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.495381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:14.496245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:14.497480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:14.497758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:14.509142 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 939/1875] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:14.639755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 937/1876] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:14 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:14.644496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:14.663413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2fb8-251f-4ddc-bbcc-f0f20962eb93 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:14.746481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:14.747324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.747874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.748182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.748994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:14.751535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:14.918845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 940/1877] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:14 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:14.919075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:14.919075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:14.922658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:14.933219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96994b-7c68-4a49-8209-52166140cd01 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:14.939107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:14.940108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.940488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.940840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] PATH_INFO: `/v3/projects/c44983d93d0440638ed1cf6576269644` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.942382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44983d93d0440638ed1cf6576269644)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:14.945232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:14.956340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701e69-6a8d-4cf4-a8b4-3f973dc3c87f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:14.965972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:14.967248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:14.967769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:14.968263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:14.969967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:14.973425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:15.005711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 941/1878] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:15.007258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:15.034443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fc765-25b9-472d-aa82-d7e4ef953ef6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:15.045729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:15.051295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:15.051295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:15.051295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:15.051295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:15.053671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:15.085010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 942/1879] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:15.086382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:15.098939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d8b29-379f-442d-82c2-94829a4a3bdb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:15.104066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:15.106090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:15.106276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:15.106562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] PATH_INFO: `/v3/projects/c5ebfd753b464d7ba94118e212d806d8/users/27730be7377b4165b9451f1a4b438164/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:15.124681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ebfd753b464d7ba94118e212d806d8, user_id=27730be7377b4165b9451f1a4b438164, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:15.128029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:15.287801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 943/1880] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:15 2022] PUT /identity/v3/projects/c5ebfd753b464d7ba94118e212d806d8/users/27730be7377b4165b9451f1a4b438164/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:15.288652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:15.292944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:15.309336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44983d93d0440638ed1cf6576269644', 'request_id': 'req-4514e447-ee92-4a38-a112-fdd7c1963b8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.318108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44983d93d0440638ed1cf6576269644', 'request_id': 'req-4514e447-ee92-4a38-a112-fdd7c1963b8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.335318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44983d93d0440638ed1cf6576269644', 'request_id': 'req-4514e447-ee92-4a38-a112-fdd7c1963b8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.418915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] The token cache is being invalidate because project c44983d93d0440638ed1cf6576269644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:15.419337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.419964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4514e447-ee92-4a38-a112-fdd7c1963b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.421612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 938/1881] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:14 2022] DELETE /identity/v3/projects/c44983d93d0440638ed1cf6576269644 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:15.427030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445bfb6-a39c-4c75-a44e-734487a15af7 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:15.427603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445bfb6-a39c-4c75-a44e-734487a15af7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:15.428175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445bfb6-a39c-4c75-a44e-734487a15af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:15.442535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee57825-23a3-46e9-a845-3b6b287e9612 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:15.488047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-9445bfb6-a39c-4c75-a44e-734487a15af7 None None] MFA Rules not processed for user `27730be7377b4165b9451f1a4b438164`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:15.490545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9445bfb6-a39c-4c75-a44e-734487a15af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:15.585646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:15.587008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:15.587478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:15.588023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] PATH_INFO: `/v3/projects/22c86b748e0d4e50bc6a5364a2f9fd49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:15.590484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c86b748e0d4e50bc6a5364a2f9fd49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:15.593330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:15.609200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:15.611502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 939/1882] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:15.613269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:15.613640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:15.614255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:15.648225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:15.649480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:15.659066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 940/1883] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:15.659881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:15.661276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:15.685439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac116c7-946a-4c45-b4f9-a7f1f904dc2e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:15.691070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d3a99-b565-472f-a78c-0fce6b319cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:15.691788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d3a99-b565-472f-a78c-0fce6b319cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:15.692071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d3a99-b565-472f-a78c-0fce6b319cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:15.692371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d3a99-b565-472f-a78c-0fce6b319cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:15.693232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d3a99-b565-472f-a78c-0fce6b319cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:15.695301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d3a99-b565-472f-a78c-0fce6b319cdf admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:15.739084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c86b748e0d4e50bc6a5364a2f9fd49', 'request_id': 'req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.880861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c86b748e0d4e50bc6a5364a2f9fd49', 'request_id': 'req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.891191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c86b748e0d4e50bc6a5364a2f9fd49', 'request_id': 'req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.894361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 941/1884] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:15 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:15.895706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:15.899845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:15.899845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:15.911279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] The token cache is being invalidate because project 22c86b748e0d4e50bc6a5364a2f9fd49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:15.911953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.912766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:15.918367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 944/1885] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:15 2022] DELETE /identity/v3/projects/22c86b748e0d4e50bc6a5364a2f9fd49 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:15.918367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:15.918367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:15.926208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:15.927465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:16.007418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 942/1886] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:16.007418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.007418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:16.012389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9ea28-e77d-4a9a-865b-b242f7ef29af admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.017487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.018218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.018497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.018771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.019478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.020871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2b446-8385-4150-8a5e-c37c216fbdda None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.021437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.027936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.029276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.029797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.030135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] PATH_INFO: `/v3/users/d4696cdebb3f4aca9f3cc9cd709f8145` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.031430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4696cdebb3f4aca9f3cc9cd709f8145)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.033594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.120734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 945/1887] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:15 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:16.121517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.132416 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f90ef-e59c-431a-8857-3a1d24d98841 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.138331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.138994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.139276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.139552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.142516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:16.142516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.142516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.170283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 946/1888] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:16.171457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.187232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb164d8-acc5-4268-9610-f31f6800dfd1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.196556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.197247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.197533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.197848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.199150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.201246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.219599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 947/1889] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:16.224487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.249642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad373f-0eff-4a41-b464-d71a3dd26230 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.257964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.259095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.259600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.260101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.262074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.265430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.322600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4696cdebb3f4aca9f3cc9cd709f8145'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:16.324597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4696cdebb3f4aca9f3cc9cd709f8145'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:16.346095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4696cdebb3f4aca9f3cc9cd709f8145'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:16.355717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4696cdebb3f4aca9f3cc9cd709f8145'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:16.356762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4696cdebb3f4aca9f3cc9cd709f8145'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:16.445740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 948/1890] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:16 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:16.447598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.450179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:16.476055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 943/1891] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:16 2022] DELETE /identity/v3/users/d4696cdebb3f4aca9f3cc9cd709f8145 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:16.477922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.482868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:16.486042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:16.553671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0fdbd-f4ae-4c44-a47c-c0d3fe30ab35 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.595958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52107941-e81c-431d-b951-6604e439ecd8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.602004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.603262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.603546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.603861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.605567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.608171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.640835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.642522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.643020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.643511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] PATH_INFO: `/v3/projects/501101536eed4034a01ea89a00595545/users/93bdd6dc234145ea91a7a236088ec35f/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.673482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501101536eed4034a01ea89a00595545, user_id=93bdd6dc234145ea91a7a236088ec35f, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.676387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.700831 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 944/1892] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:16 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:16.706074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.718272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c291-6931-4ab4-84d9-21d3010bc0ec admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.723734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.724427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.724806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.725150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.726019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.727774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.740066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 945/1893] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:16.743947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.754458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07060bbb-71f7-4d04-a7c7-610aad64ee46 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.760132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.760857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.761129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.761449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.762287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.763918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.775758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 946/1894] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:16.780947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.791230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0738e6-f415-4d62-be2e-eb6679f1819a admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.797231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c4e4a-5d84-4f4e-98f3-25765b471b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.798282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4e4a-5d84-4f4e-98f3-25765b471b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.798674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4e4a-5d84-4f4e-98f3-25765b471b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.799056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4e4a-5d84-4f4e-98f3-25765b471b27 admin admin] PATH_INFO: `/v3/projects/859bfe5565d94ee89b7a630adca80bcd/users/5f02184900c446728257638e60476052/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.814868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 949/1895] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:16 2022] PUT /identity/v3/projects/501101536eed4034a01ea89a00595545/users/93bdd6dc234145ea91a7a236088ec35f/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:16.824117 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c4e4a-5d84-4f4e-98f3-25765b471b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859bfe5565d94ee89b7a630adca80bcd, user_id=5f02184900c446728257638e60476052, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.824633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c4e4a-5d84-4f4e-98f3-25765b471b27 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.827946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.923780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0cd48-a9f7-4d0b-abb3-100790684965 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:16.928992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:16.929738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.930019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.930300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.931043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:16.932758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:16.947514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 950/1896] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:16.959331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 947/1897] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:16 2022] PUT /identity/v3/projects/859bfe5565d94ee89b7a630adca80bcd/users/5f02184900c446728257638e60476052/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:16.960093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:16.961934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7c613-dd2e-46b7-b619-e93a72c7ac0c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:16.963016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7c613-dd2e-46b7-b619-e93a72c7ac0c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:16.963532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7c613-dd2e-46b7-b619-e93a72c7ac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:16.975703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59e5e-70d2-4471-ae07-87c1f6c0eb95 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.017981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-54d7c613-dd2e-46b7-b619-e93a72c7ac0c None None] MFA Rules not processed for user `5f02184900c446728257638e60476052`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:17.019680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-54d7c613-dd2e-46b7-b619-e93a72c7ac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:17.066021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027720a-7a77-4aa0-8a42-875bacc2405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.066942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027720a-7a77-4aa0-8a42-875bacc2405b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.067223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027720a-7a77-4aa0-8a42-875bacc2405b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.067500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027720a-7a77-4aa0-8a42-875bacc2405b admin admin] PATH_INFO: `/v3/projects/501101536eed4034a01ea89a00595545/users/93bdd6dc234145ea91a7a236088ec35f/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.069724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027720a-7a77-4aa0-8a42-875bacc2405b admin admin] RBAC: Authorizing `identity:create_grant(project_id=501101536eed4034a01ea89a00595545, user_id=93bdd6dc234145ea91a7a236088ec35f, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.072459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027720a-7a77-4aa0-8a42-875bacc2405b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.085292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 951/1898] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:16 2022] PUT /identity/v3/projects/501101536eed4034a01ea89a00595545/users/93bdd6dc234145ea91a7a236088ec35f/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:17.098141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.098591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.099020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.103863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 948/1899] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:17.117529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7c613-dd2e-46b7-b619-e93a72c7ac0c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.132315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] MFA Rules not processed for user `93bdd6dc234145ea91a7a236088ec35f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:17.133653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:17.137381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7c613-dd2e-46b7-b619-e93a72c7ac0c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.205428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.206140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.206432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.206751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.207495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.209486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.227149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 952/1900] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:17.227882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.229284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:17.243530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfc968-dac1-4db9-9fe1-1faa0fe1c430 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.249121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.250037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.250324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.250602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] PATH_INFO: `/v3/projects/d8c1506ad1bb4d96bff34a57230706dd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.251837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c1506ad1bb4d96bff34a57230706dd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.253811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.356740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 949/1901] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:17 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:17.361510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.362804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:17.402446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c1506ad1bb4d96bff34a57230706dd', 'request_id': 'req-23dd11ad-a87e-4a96-a02a-7c3a5f013333'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:17.452035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7c8ef-f107-4b3c-8fe8-cf6f30efd090 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.521721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c1506ad1bb4d96bff34a57230706dd', 'request_id': 'req-23dd11ad-a87e-4a96-a02a-7c3a5f013333'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:17.532620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde6781-3b21-4ae0-934b-c8097583689b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.534127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6781-3b21-4ae0-934b-c8097583689b service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.534625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6781-3b21-4ae0-934b-c8097583689b service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.534853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c1506ad1bb4d96bff34a57230706dd', 'request_id': 'req-23dd11ad-a87e-4a96-a02a-7c3a5f013333'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:17.535131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6781-3b21-4ae0-934b-c8097583689b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.554953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] The token cache is being invalidate because project d8c1506ad1bb4d96bff34a57230706dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:17.555345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:17.556187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:17.563655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 953/1902] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:17 2022] DELETE /identity/v3/projects/d8c1506ad1bb4d96bff34a57230706dd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:17.566150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.569355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:17.636257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde6781-3b21-4ae0-934b-c8097583689b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.638799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde6781-3b21-4ae0-934b-c8097583689b service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.650072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 950/1903] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:17.652479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccf142-8c88-4512-8454-6dff6270e023 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.652757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccf142-8c88-4512-8454-6dff6270e023 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.653132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccf142-8c88-4512-8454-6dff6270e023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.668161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd11ad-a87e-4a96-a02a-7c3a5f013333 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.672764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7cccf142-8c88-4512-8454-6dff6270e023 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:17.673766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.674240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7cccf142-8c88-4512-8454-6dff6270e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:17.674618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.674982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.675327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.676113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.678638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.693980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 951/1904] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:17.706998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e946-97ac-4e25-9e18-160560d60240 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.707615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e946-97ac-4e25-9e18-160560d60240 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.714594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e946-97ac-4e25-9e18-160560d60240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.741072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-11d6e946-97ac-4e25-9e18-160560d60240 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:17.743235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-11d6e946-97ac-4e25-9e18-160560d60240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:17.758059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 952/1905] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:17.764944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6e946-97ac-4e25-9e18-160560d60240 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.775403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6e946-97ac-4e25-9e18-160560d60240 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.781298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.782017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.782409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.782662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.783417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:17.783732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.785430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.799316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 953/1906] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:47:17.805445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.816749 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685d50-bc03-47ad-9cba-ffe79dcc2a84 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.821944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.822719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.823537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.823774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.824950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.828545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.834576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 954/1907] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:17 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:17.839805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.850758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5dd4-1e77-4bc5-9dab-8cc05b9ced79 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.856568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.857832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.858444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.858914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.860190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.863075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:17.883227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 955/1908] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:17.888901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.906446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f1f24-63a3-4ae0-9efb-8bce8a07a797 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:17.911881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:17.912948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:17.913371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:17.913769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] PATH_INFO: `/v3/projects/c608416448ff4bb7980aa1f4c65108d8/users/c2d164c52b7b408c9e453ce3102767f5/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:17.941196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 954/1909] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:17 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:17.946939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:17.952906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c608416448ff4bb7980aa1f4c65108d8, user_id=c2d164c52b7b408c9e453ce3102767f5, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:17.960371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.047645 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a680-e41f-4571-912d-3d05cd866e03 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.056438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.057157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.058265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.058561 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.060196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.061473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.099380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 956/1910] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:17 2022] PUT /identity/v3/projects/c608416448ff4bb7980aa1f4c65108d8/users/c2d164c52b7b408c9e453ce3102767f5/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:18.105082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:18.193791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 955/1911] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:17 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:18.201638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:18.232304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:18.256639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2e1e-08d7-4a0b-b094-a4414b376de3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.272902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.273772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.274000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.274283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.274956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac884-1712-4c81-ac42-d4de132b09f0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.275070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.277020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.284195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.285959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.285959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.286584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.288480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.292678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.318290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 957/1912] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:18.319297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:18.331661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 956/1913] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:18.333070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622f34-c421-4d7f-9569-bed773af6db8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.334699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:18.338717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c38f2b-2393-446d-b815-c83d1599f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.340055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38f2b-2393-446d-b815-c83d1599f7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.340429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38f2b-2393-446d-b815-c83d1599f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.340960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38f2b-2393-446d-b815-c83d1599f7a6 admin admin] PATH_INFO: `/v3/projects/c608416448ff4bb7980aa1f4c65108d8/users/c2d164c52b7b408c9e453ce3102767f5/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.344739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c38f2b-2393-446d-b815-c83d1599f7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c608416448ff4bb7980aa1f4c65108d8, user_id=c2d164c52b7b408c9e453ce3102767f5, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.347669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c38f2b-2393-446d-b815-c83d1599f7a6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.357427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d56e6-3f2d-4f01-b615-e9223632588c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.362602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 958/1914] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:18 2022] PUT /identity/v3/projects/c608416448ff4bb7980aa1f4c65108d8/users/c2d164c52b7b408c9e453ce3102767f5/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:18.373939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.374244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.374544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.413093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] MFA Rules not processed for user `c2d164c52b7b408c9e453ce3102767f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:18.415583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:18.435859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.436554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.436843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.437132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.437986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.439744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.473251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 957/1915] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:18.478121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:18.507857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059151-39e4-4f8b-ad01-8c04f0127db6 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.519508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.519508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.519508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.519508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] PATH_INFO: `/v3/projects/2a050723639d4bb2b06a0c2f29ecc6a0/users/88138b67b9984b19bb69fdafb680c74f/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.544184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 959/1916] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:18.546501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:18.556825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:18.556970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a050723639d4bb2b06a0c2f29ecc6a0, user_id=88138b67b9984b19bb69fdafb680c74f, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.556970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.577552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054dcd-1b31-4fbd-b7da-8bc7b080f8f1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.582758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.583669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.583955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.584271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] PATH_INFO: `/v3/users/27730be7377b4165b9451f1a4b438164` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.585624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27730be7377b4165b9451f1a4b438164)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.587729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.656449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 958/1917] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:18 2022] PUT /identity/v3/projects/2a050723639d4bb2b06a0c2f29ecc6a0/users/88138b67b9984b19bb69fdafb680c74f/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:18.657452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:18.663675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:18.805295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188d50-1691-4c64-85a5-2c90c132c9c9 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:18.817626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51e4e-453f-435e-ae11-64e53c14dd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:18.818352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e4e-453f-435e-ae11-64e53c14dd6f service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.818643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e4e-453f-435e-ae11-64e53c14dd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.818924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e4e-453f-435e-ae11-64e53c14dd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.847727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:18.918782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27730be7377b4165b9451f1a4b438164'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:18.919852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27730be7377b4165b9451f1a4b438164'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:18.928402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51e4e-453f-435e-ae11-64e53c14dd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:18.930826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51e4e-453f-435e-ae11-64e53c14dd6f service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:18.946643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27730be7377b4165b9451f1a4b438164'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:18.947021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 959/1918] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:18.948939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:18.949248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:18.949497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:18.965147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27730be7377b4165b9451f1a4b438164'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:18.965713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d86d0973-39b0-4d22-b227-e5613c56d4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27730be7377b4165b9451f1a4b438164'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:18.993665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] MFA Rules not processed for user `88138b67b9984b19bb69fdafb680c74f`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:18.995550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:19.098813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 960/1919] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:19.103622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:19.105662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:19.120930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 960/1920] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:18 2022] DELETE /identity/v3/users/27730be7377b4165b9451f1a4b438164 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:19.135983 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.137272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.137272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.155673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:19.156984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:19.207832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeaa86-ce5b-449a-9d2c-f95e95e375fd None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:19.237127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 961/1921] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:19.238344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:19.240040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:19.375680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:19.378361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.378974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.380035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.381140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785870-abec-48ba-8b43-e04ecfe6bee2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:19.382608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:19.387885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:19.389321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:19.390091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.390806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.396080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.396080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:19.478358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:19.480287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:19.488581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 961/1922] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:19 2022] POST /identity/v3/projects => generated 377 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:19.489381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:19.492411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:19.521457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 962/1923] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:19.522431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:19.537409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd423-878b-4d46-8d74-9686e4c4da75 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:19.615639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:19.616712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.617282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.617860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.618718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:19.621079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50269ae8-5f60-4350-8d56-dcfe0754a52f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:19.622184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:19.628377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:19.629553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.630304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.630799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.648619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:19.655795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:19.669335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 962/1924] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:19.744613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 963/1925] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:19 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:19.748860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:19.759718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6813-f49f-4a4b-bda8-2ea15e4090d0 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:19.767158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:19.768009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.768503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.768892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.769648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:19.772103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:19.787846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 963/1926] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:19.793466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:19.811349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac033d4-233d-4ecb-b58e-97c2ecf6cf3e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:19.819570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881930d4-c84d-444a-ad3a-fbc1450d2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:19.820775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881930d4-c84d-444a-ad3a-fbc1450d2cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.821297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881930d4-c84d-444a-ad3a-fbc1450d2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.821863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881930d4-c84d-444a-ad3a-fbc1450d2cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.823369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881930d4-c84d-444a-ad3a-fbc1450d2cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:19.826808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881930d4-c84d-444a-ad3a-fbc1450d2cc2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:19.849613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 964/1927] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:19.855226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:19.875466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3346c8-2f55-4f16-9b55-ead7e2ad3305 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:19.884315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:19.886724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:19.887315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:19.887825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] PATH_INFO: `/v3/projects/7967227d817a44508f3e9555e24ae7fc/users/7a06bb6596574f1f91c7044bc74fa6a8/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:19.918667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7967227d817a44508f3e9555e24ae7fc, user_id=7a06bb6596574f1f91c7044bc74fa6a8, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:19.924361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:20.031345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 964/1928] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:19 2022] PUT /identity/v3/projects/7967227d817a44508f3e9555e24ae7fc/users/7a06bb6596574f1f91c7044bc74fa6a8/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:20.045506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:20.045829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:20.046109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:20.078497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] MFA Rules not processed for user `7a06bb6596574f1f91c7044bc74fa6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:20.079939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:20.175694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:20.178864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 965/1929] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:20.183235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:20.187275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:20.189013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:20.286274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed9467-8336-4b08-8adf-a1a927bf341b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:20.291745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:20.292794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:20.293017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:20.293199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:20.294146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:20.296361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:20.302115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f691ce-437c-4ac6-a1c6-ab2fcd8b9b2d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:20.310721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:20.311419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:20.312082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:20.312380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] PATH_INFO: `/v3/projects/c5ebfd753b464d7ba94118e212d806d8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:20.313083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:20.314026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ebfd753b464d7ba94118e212d806d8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:20.316556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:20.429723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 965/1930] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:20 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:20.436140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:20.543436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ebfd753b464d7ba94118e212d806d8', 'request_id': 'req-1674d85e-8d34-4172-bbb1-85b669c7780a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:20.611274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592562-8c0c-43e0-8814-67ce5ffa171b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:20.686553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ebfd753b464d7ba94118e212d806d8', 'request_id': 'req-1674d85e-8d34-4172-bbb1-85b669c7780a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:20.695224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ebfd753b464d7ba94118e212d806d8', 'request_id': 'req-1674d85e-8d34-4172-bbb1-85b669c7780a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:20.723203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] The token cache is being invalidate because project c5ebfd753b464d7ba94118e212d806d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:20.723617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:20.726941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:20.731121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 966/1931] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:20 2022] DELETE /identity/v3/projects/c5ebfd753b464d7ba94118e212d806d8 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:20.739670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:20.741150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:20.797205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:20.798282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:20.798643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:20.799244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:20.800545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:20.804202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:20.880977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d85e-8d34-4172-bbb1-85b669c7780a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:20.888368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:20.889359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:20.889660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:20.890058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] PATH_INFO: `/v3/users/93bdd6dc234145ea91a7a236088ec35f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:20.892700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bdd6dc234145ea91a7a236088ec35f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:20.895237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:20.970564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 966/1932] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:20 2022] POST /identity/v3/users => generated 296 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:20.983032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:20.986269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:21.003539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372961b-7cfa-47f0-8896-81f5a3ee8f20 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:21.027947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:21.028990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.029347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.029728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.030610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:21.032756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:21.047763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 967/1933] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:21.056450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:21.069799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdc035-6a42-4ba2-95f3-35ddc18c60b9 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:21.076185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb19b8-6974-4638-ab01-d7c16cd65394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:21.077104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb19b8-6974-4638-ab01-d7c16cd65394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.077383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb19b8-6974-4638-ab01-d7c16cd65394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.077655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb19b8-6974-4638-ab01-d7c16cd65394 admin admin] PATH_INFO: `/v3/projects/7b8085bb175940398fb6fe5912a308ba/users/4d491538b60d403da08cfef4c4f4f055/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.096956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb19b8-6974-4638-ab01-d7c16cd65394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8085bb175940398fb6fe5912a308ba, user_id=4d491538b60d403da08cfef4c4f4f055, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:21.099964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb19b8-6974-4638-ab01-d7c16cd65394 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:21.182941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 968/1934] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:21 2022] PUT /identity/v3/projects/7b8085bb175940398fb6fe5912a308ba/users/4d491538b60d403da08cfef4c4f4f055/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:21.185453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d318-5e0f-4f33-9065-1f1a8a5b114c None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.186444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d318-5e0f-4f33-9065-1f1a8a5b114c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.186585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d318-5e0f-4f33-9065-1f1a8a5b114c None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.189995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 969/1935] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:47:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:47:21.191581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d318-5e0f-4f33-9065-1f1a8a5b114c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:21.198315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bdd6dc234145ea91a7a236088ec35f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:21.199618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bdd6dc234145ea91a7a236088ec35f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:21.221575 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bdd6dc234145ea91a7a236088ec35f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:21.234818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bdd6dc234145ea91a7a236088ec35f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:21.236736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eea4f3d9-12d0-44df-9e57-4443a729d79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bdd6dc234145ea91a7a236088ec35f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:21.337823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d318-5e0f-4f33-9065-1f1a8a5b114c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:21.345016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 967/1936] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:20 2022] DELETE /identity/v3/users/93bdd6dc234145ea91a7a236088ec35f => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:21.347284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.347878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.348470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.349138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:21.350346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.350839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.351975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.352696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:21.358584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:21.394658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 970/1937] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:21.402587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:21.406471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:21.418796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:21.420707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:21.429654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbffa9-4e2a-4090-9f7a-48d15844a5f8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:21.547714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e3b0-2f56-4fb1-8616-3b0b68724a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:21.553293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e3b0-2f56-4fb1-8616-3b0b68724a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.555475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e3b0-2f56-4fb1-8616-3b0b68724a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.559505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e3b0-2f56-4fb1-8616-3b0b68724a7e admin admin] PATH_INFO: `/v3/projects/7b8085bb175940398fb6fe5912a308ba/users/4d491538b60d403da08cfef4c4f4f055/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.561598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557e3b0-2f56-4fb1-8616-3b0b68724a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8085bb175940398fb6fe5912a308ba, user_id=4d491538b60d403da08cfef4c4f4f055, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:21.567429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557e3b0-2f56-4fb1-8616-3b0b68724a7e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:21.602383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 971/1938] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:21 2022] PUT /identity/v3/projects/7b8085bb175940398fb6fe5912a308ba/users/4d491538b60d403da08cfef4c4f4f055/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:21.604071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.605220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.605220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.629462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 968/1939] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:47:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:21.641977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] MFA Rules not processed for user `4d491538b60d403da08cfef4c4f4f055`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:21.643652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:21.744583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:21.753263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 972/1940] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:21.774059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:21.777148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:21.892912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6900145-a0f1-4bc0-a307-56e3079f4348 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:21.957871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:21.968532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:21.969589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:21.970342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:21.971201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:21.993257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:21.996327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:22.039748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:22.041498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 969/1941] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:22.045336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:22.259153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab6a1-198e-48b7-b559-73ba649b795b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:22.266993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:22.276209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:22.277173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:22.277657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:22.278189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:22.279673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faf860-af36-4f7b-a26b-dd797185ebc7 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:22.295291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368cd13-fdf3-45a0-8f32-827a45d69297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:22.297254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368cd13-fdf3-45a0-8f32-827a45d69297 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:22.298913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368cd13-fdf3-45a0-8f32-827a45d69297 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:22.306263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368cd13-fdf3-45a0-8f32-827a45d69297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:22.306642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:22.306935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:22.311130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7368cd13-fdf3-45a0-8f32-827a45d69297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:22.333238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 973/1942] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:47:22.474851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:22.476837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:22.511169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:22.555089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368cd13-fdf3-45a0-8f32-827a45d69297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:22.560866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368cd13-fdf3-45a0-8f32-827a45d69297 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:22.582564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 970/1943] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:22.738175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c9e60-178e-4182-be66-2a2910ae1254 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:22.745278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:22.746524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:22.746961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:22.747324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] PATH_INFO: `/v3/projects/501101536eed4034a01ea89a00595545` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:22.765162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501101536eed4034a01ea89a00595545)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:22.767711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:22.837020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:23.025095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501101536eed4034a01ea89a00595545', 'request_id': 'req-a2157d10-b21a-4c83-8f32-905479c5b3f9'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:23.055155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501101536eed4034a01ea89a00595545', 'request_id': 'req-a2157d10-b21a-4c83-8f32-905479c5b3f9'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:23.100047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501101536eed4034a01ea89a00595545', 'request_id': 'req-a2157d10-b21a-4c83-8f32-905479c5b3f9'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:23.222336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] The token cache is being invalidate because project 501101536eed4034a01ea89a00595545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:23.223214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:23.224991 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2157d10-b21a-4c83-8f32-905479c5b3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:23.226989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 974/1944] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:22 2022] DELETE /identity/v3/projects/501101536eed4034a01ea89a00595545 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:23.233003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa759e-6a68-4a89-8c8d-f7120acac5c3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:23.234062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa759e-6a68-4a89-8c8d-f7120acac5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:23.234062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa759e-6a68-4a89-8c8d-f7120acac5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:23.316380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-22aa759e-6a68-4a89-8c8d-f7120acac5c3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:23.321535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-22aa759e-6a68-4a89-8c8d-f7120acac5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:23.493118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 971/1945] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:23.505923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953796a2-2516-4b1a-bb58-f1ba30896ba8 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:23.509303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953796a2-2516-4b1a-bb58-f1ba30896ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:23.509303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953796a2-2516-4b1a-bb58-f1ba30896ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:23.599481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-953796a2-2516-4b1a-bb58-f1ba30896ba8 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:23.612145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-953796a2-2516-4b1a-bb58-f1ba30896ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:23.638186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 975/1946] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:23.642542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa759e-6a68-4a89-8c8d-f7120acac5c3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:23.659563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa759e-6a68-4a89-8c8d-f7120acac5c3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:23.669812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:23.675606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:23.675606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:23.675606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:23.678756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:23.679157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:23.680868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:23.752905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 972/1947] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:47:23.759024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953796a2-2516-4b1a-bb58-f1ba30896ba8 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:23.778763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:23.782052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953796a2-2516-4b1a-bb58-f1ba30896ba8 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:23.791094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:23.792294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:23.795382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:23.795382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:23.795382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:23.797531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:23.859780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:23.927665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 976/1948] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:23 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:23.932487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:23.946274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300a99-7b6a-4d85-b53b-6d922d8a3378 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:24.050044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:24.051027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:24.057298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:24.057298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:24.057298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:24.057298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:24.221035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:24.235875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 973/1949] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:23 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:24.263350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ff842-49fe-48c3-94cf-590be200882b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:24.282650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:24.289826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:24.289826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:24.289826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:24.289826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:24.289826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:24.321369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 977/1950] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:24.324925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:24.357877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f902-68d9-4112-8d23-1345e7cf6bfe admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:24.378568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e3c63-d5b7-40c7-8ad3-9abaad139bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:24.382341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3c63-d5b7-40c7-8ad3-9abaad139bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:24.382954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3c63-d5b7-40c7-8ad3-9abaad139bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:24.389490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3c63-d5b7-40c7-8ad3-9abaad139bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:24.389490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e3c63-d5b7-40c7-8ad3-9abaad139bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:24.394527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e3c63-d5b7-40c7-8ad3-9abaad139bf1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:24.438506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 974/1951] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:24.445260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:24.462895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9a1fd-831e-410a-85e3-9c00c8a76aa8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:24.480902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:24.483889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:24.484263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:24.484627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] PATH_INFO: `/v3/projects/03fee300103a4f08a3577097d44ffad2/users/67e28ab6de7d49da8dcebaca85009802/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:24.498821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:24.520236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fee300103a4f08a3577097d44ffad2, user_id=67e28ab6de7d49da8dcebaca85009802, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:24.524434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:24.648144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 978/1952] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:24 2022] PUT /identity/v3/projects/03fee300103a4f08a3577097d44ffad2/users/67e28ab6de7d49da8dcebaca85009802/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:24.661434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154d03-8e08-4990-9b0e-2c02060f6970 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:24.661860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154d03-8e08-4990-9b0e-2c02060f6970 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:24.662317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154d03-8e08-4990-9b0e-2c02060f6970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:24.695667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a1154d03-8e08-4990-9b0e-2c02060f6970 None None] MFA Rules not processed for user `67e28ab6de7d49da8dcebaca85009802`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:24.696961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a1154d03-8e08-4990-9b0e-2c02060f6970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:24.785774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 975/1953] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:24.790366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:24.906583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796fb10-a0c0-4b47-8c0d-2f10e404a85e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:24.913752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:24.914444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:24.914735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:24.915172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:24.915882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:24.917931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:25.086522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 979/1954] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:24 2022] POST /identity/v3/projects => generated 383 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:25.088061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1154d03-8e08-4990-9b0e-2c02060f6970 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:25.099696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1154d03-8e08-4990-9b0e-2c02060f6970 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:25.188839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:25.189787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:25.190772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:25.191199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:25.191865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:25.194756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:25.318163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:25.328796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 976/1955] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:25 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:25.331474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:25.350706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c4eb9-2937-412a-9f9a-18e952d0ff24 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:25.369001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:25.369736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:25.370703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:25.371159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:25.383786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:25.383786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:25.394204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 980/1956] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:25.399460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:25.415827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124ef6-88f4-4735-9483-c0b305498faf admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:25.422021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:25.423027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:25.423435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:25.423717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] PATH_INFO: `/v3/projects/54e0bebbfc664b2cb37df03f52c0deb3/users/43ddb1b08157455dbcb0f38f110a24fc/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:25.449122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e0bebbfc664b2cb37df03f52c0deb3, user_id=43ddb1b08157455dbcb0f38f110a24fc, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:25.453320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:25.534806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 977/1957] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:25 2022] PUT /identity/v3/projects/54e0bebbfc664b2cb37df03f52c0deb3/users/43ddb1b08157455dbcb0f38f110a24fc/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:25.540317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:25.559814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:25.570708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35bfb9-f2ac-4c17-b80d-4083e400601f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:25.654156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389091a-f239-401b-bfa0-285b9b66917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:25.655059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389091a-f239-401b-bfa0-285b9b66917f admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:25.655490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389091a-f239-401b-bfa0-285b9b66917f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:25.656140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389091a-f239-401b-bfa0-285b9b66917f admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:25.657210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389091a-f239-401b-bfa0-285b9b66917f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:25.659516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389091a-f239-401b-bfa0-285b9b66917f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:25.672727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 981/1958] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:25.677428 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:25.689028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ef2d3-34e0-45c9-9e35-1b486e7fcd09 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:25.694092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:25.694999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:25.695350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:25.695718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] PATH_INFO: `/v3/projects/54e0bebbfc664b2cb37df03f52c0deb3/users/43ddb1b08157455dbcb0f38f110a24fc/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:25.697925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e0bebbfc664b2cb37df03f52c0deb3, user_id=43ddb1b08157455dbcb0f38f110a24fc, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:25.701130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:25.715954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 978/1959] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:25 2022] PUT /identity/v3/projects/54e0bebbfc664b2cb37df03f52c0deb3/users/43ddb1b08157455dbcb0f38f110a24fc/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:25.735077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:25.735598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:25.735912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:25.778975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] MFA Rules not processed for user `43ddb1b08157455dbcb0f38f110a24fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:25.780350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:25.864494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 982/1960] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:25.875374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:25.877200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:25.943300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:25.945204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:25.949614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f3c2-f2fd-469a-a9bb-f7552f88b2ef admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:25.958917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2fbe2-eab6-4215-97cd-7fcc616cb656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:25.959705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fbe2-eab6-4215-97cd-7fcc616cb656 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:25.960101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fbe2-eab6-4215-97cd-7fcc616cb656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:25.960477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fbe2-eab6-4215-97cd-7fcc616cb656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:26.060590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2fbe2-eab6-4215-97cd-7fcc616cb656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:26.062291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2fbe2-eab6-4215-97cd-7fcc616cb656 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:26.071060 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb01f-7c77-4f7a-987b-5bdd72e4fe71 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:26.077271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:26.078224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 979/1961] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:26.087026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:26.087151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:26.087411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:26.087761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] PATH_INFO: `/v3/users/5f02184900c446728257638e60476052` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:26.089789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f02184900c446728257638e60476052)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:26.091915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:26.178299 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:26.303707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f02184900c446728257638e60476052'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:26.305171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f02184900c446728257638e60476052'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:26.327369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f02184900c446728257638e60476052'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:26.336529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f02184900c446728257638e60476052'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:26.337412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f02184900c446728257638e60476052'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:26.346629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:26.424190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:26.466026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 983/1962] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:25 2022] DELETE /identity/v3/users/5f02184900c446728257638e60476052 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:26.472499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:26.473183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:26.474675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:26.497902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:26.509634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:26.579710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 980/1963] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:26.586739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:26.589140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:26.649423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:26.684971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e8021-275e-41a1-a423-6bc511111b46 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:26.691188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:26.691970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:26.692451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:26.692834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:26.705542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:26.707121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:26.717825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 984/1964] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:27.289353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:27.295916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:27.297859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:27.318263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121401f1-6b84-4236-9b39-edbb52de0114 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:27.328039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:27.330073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:27.330568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:27.330946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] PATH_INFO: `/v3/projects/859bfe5565d94ee89b7a630adca80bcd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:27.333271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859bfe5565d94ee89b7a630adca80bcd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:27.336348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:27.532967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859bfe5565d94ee89b7a630adca80bcd', 'request_id': 'req-9c04e23d-14f4-4533-ba4b-a492376f4f79'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:27.654535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859bfe5565d94ee89b7a630adca80bcd', 'request_id': 'req-9c04e23d-14f4-4533-ba4b-a492376f4f79'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:27.660959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859bfe5565d94ee89b7a630adca80bcd', 'request_id': 'req-9c04e23d-14f4-4533-ba4b-a492376f4f79'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:27.674043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] The token cache is being invalidate because project 859bfe5565d94ee89b7a630adca80bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:27.674257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:27.674941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:27.676532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 981/1965] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:27 2022] DELETE /identity/v3/projects/859bfe5565d94ee89b7a630adca80bcd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:27.684244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:27.697506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4dca3-da25-4950-99ab-4b57090a03c6 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:27.824877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:27.853026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:27.853026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:27.865988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:27.867124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] PATH_INFO: `/v3/users/c2d164c52b7b408c9e453ce3102767f5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:27.873183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d164c52b7b408c9e453ce3102767f5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:27.881886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:28.252832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d164c52b7b408c9e453ce3102767f5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:28.264296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:28.269513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d164c52b7b408c9e453ce3102767f5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:28.304431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d164c52b7b408c9e453ce3102767f5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:28.319127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d164c52b7b408c9e453ce3102767f5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:28.321715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-bc912c98-a149-4f6a-b848-1384b24fd60f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d164c52b7b408c9e453ce3102767f5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:28.436962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 985/1966] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:27 2022] DELETE /identity/v3/users/c2d164c52b7b408c9e453ce3102767f5 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:28.816926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:29.335557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:29.337433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:29.374833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04e23d-14f4-4533-ba4b-a492376f4f79 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:29.487743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:29.490961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:29.490961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:29.490961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] PATH_INFO: `/v3/projects/c608416448ff4bb7980aa1f4c65108d8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:29.492988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c608416448ff4bb7980aa1f4c65108d8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:29.498492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:29.601660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:29.673096 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c608416448ff4bb7980aa1f4c65108d8', 'request_id': 'req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:29.795377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c608416448ff4bb7980aa1f4c65108d8', 'request_id': 'req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:29.804103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c608416448ff4bb7980aa1f4c65108d8', 'request_id': 'req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:29.818652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] The token cache is being invalidate because project c608416448ff4bb7980aa1f4c65108d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:29.819698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:29.820523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9dca514b-46f8-4ee3-8716-6bbeb4f84fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:29.822856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 982/1967] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:29 2022] DELETE /identity/v3/projects/c608416448ff4bb7980aa1f4c65108d8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:29.829062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66370ec-dc03-4484-8b04-7ac00853b8aa None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:29.831387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66370ec-dc03-4484-8b04-7ac00853b8aa None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:29.831387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66370ec-dc03-4484-8b04-7ac00853b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:29.856063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b66370ec-dc03-4484-8b04-7ac00853b8aa None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:29.857437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b66370ec-dc03-4484-8b04-7ac00853b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:29.943867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 986/1968] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:29.953859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a0d6-cd24-47e6-a49f-a436e7e49524 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:29.954150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a0d6-cd24-47e6-a49f-a436e7e49524 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:29.954437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a0d6-cd24-47e6-a49f-a436e7e49524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:29.974679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f415a0d6-cd24-47e6-a49f-a436e7e49524 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:29.976322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f415a0d6-cd24-47e6-a49f-a436e7e49524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:29.986281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 983/1969] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:29.992097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66370ec-dc03-4484-8b04-7ac00853b8aa None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.004421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66370ec-dc03-4484-8b04-7ac00853b8aa None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.010816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.011719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.012116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.012731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.013594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:30.014036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:30.016950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:30.039034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 987/1970] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:30.044600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a0d6-cd24-47e6-a49f-a436e7e49524 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.055710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415a0d6-cd24-47e6-a49f-a436e7e49524 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.061246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.062241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.062531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.062824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.063532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:30.065484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:30.202496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.204538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:30.216063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 984/1971] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:30 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:30.220628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834129-466a-40b1-aa34-88b9ce40661e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.239459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.285566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.286520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.287025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.287323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] PATH_INFO: `/v3/users/88138b67b9984b19bb69fdafb680c74f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.287461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:30.288595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88138b67b9984b19bb69fdafb680c74f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:30.290726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:30.321136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f938763-8d9d-47a1-957c-28c72f67f948 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.327999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.328730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.329022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.329330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.330080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:30.332156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:30.500078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 985/1972] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:30 2022] POST /identity/v3/users => generated 282 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:30.502969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.518370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba24f-ce21-4579-9863-925ee2ae458d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.537162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.537162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.537162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.537162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.537486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:30.537486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:30.551032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88138b67b9984b19bb69fdafb680c74f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:30.552044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88138b67b9984b19bb69fdafb680c74f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:30.556293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 986/1973] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:30.558542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.560912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:30.568996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88138b67b9984b19bb69fdafb680c74f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:30.579865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f342-7a83-42af-ba3a-5fa677e7338e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.585037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88138b67b9984b19bb69fdafb680c74f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:30.585823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-16c47ee4-ef32-4f3b-822d-cd86c2e70997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88138b67b9984b19bb69fdafb680c74f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:30.588931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.589914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.590370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.590887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.591803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:30.593633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:30.607412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 987/1974] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:30.611888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.625353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c6a7-0ecc-4277-aba3-bd3c352f51c6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.631514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13f7f7-d26e-4aae-97eb-786ace3d6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.632506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f7f7-d26e-4aae-97eb-786ace3d6055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.632791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f7f7-d26e-4aae-97eb-786ace3d6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.633069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f7f7-d26e-4aae-97eb-786ace3d6055 admin admin] PATH_INFO: `/v3/projects/408358db177e4ee9a179b334f295bb6f/users/9ff63693fcda4b47b3296407d254a47d/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.649401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13f7f7-d26e-4aae-97eb-786ace3d6055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408358db177e4ee9a179b334f295bb6f, user_id=9ff63693fcda4b47b3296407d254a47d, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:30.652439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13f7f7-d26e-4aae-97eb-786ace3d6055 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:30.683097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 988/1975] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:30 2022] DELETE /identity/v3/users/88138b67b9984b19bb69fdafb680c74f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:30.688348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.688796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.689014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.706921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:30.708198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:30.781114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 988/1976] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:30 2022] PUT /identity/v3/projects/408358db177e4ee9a179b334f295bb6f/users/9ff63693fcda4b47b3296407d254a47d/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:30.792960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 989/1977] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:30.802915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7cd0-022c-4d0e-a0d8-3c3564903650 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.802915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7cd0-022c-4d0e-a0d8-3c3564903650 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.802915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7cd0-022c-4d0e-a0d8-3c3564903650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:30.808044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.810268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:30.837089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7d0c7cd0-022c-4d0e-a0d8-3c3564903650 None None] MFA Rules not processed for user `9ff63693fcda4b47b3296407d254a47d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:30.838421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7d0c7cd0-022c-4d0e-a0d8-3c3564903650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:30.889318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d081115-7c6b-43de-b00b-13be71b59851 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:30.929135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 989/1978] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:30.929498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:30.937010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7cd0-022c-4d0e-a0d8-3c3564903650 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:30.986938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:30.987888 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:30.988306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:30.988726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:31.046904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7cd0-022c-4d0e-a0d8-3c3564903650 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:31.054018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:31.055679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:31.056142 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:31.056646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:31.057809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:31.060896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:31.126728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:31.128443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:31.141402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 990/1979] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:31.149771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:31.240060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 990/1980] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:30 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:31.245535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:31.270634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f73d-cfc5-4f80-9ce2-bd2c31a0a1d1 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:31.377415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:31.378515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:31.378803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:31.379083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:31.379805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:31.382281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:31.543294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:31.554853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 991/1981] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:31 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:31.560235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24b91-696f-423b-8856-55770113d8ca admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:31.581383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:31.582479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:31.582920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:31.583688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:31.600073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:31.608186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:31.618592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:31.644199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 991/1982] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:31.646675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:31.661062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ae38-88a4-47b7-8a9e-54446924308f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:31.686736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:31.686736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:31.686736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:31.686736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] PATH_INFO: `/v3/projects/cc7bf7d3acd541e8a47418f7dc0f64be/users/1107dce296704141af79b37238d93803/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:31.719895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7bf7d3acd541e8a47418f7dc0f64be, user_id=1107dce296704141af79b37238d93803, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:31.722936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:31.804669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 992/1983] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:31 2022] PUT /identity/v3/projects/cc7bf7d3acd541e8a47418f7dc0f64be/users/1107dce296704141af79b37238d93803/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:31.809108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:31.820245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be425b9-1586-4044-89ab-896fe698cd22 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:31.917311 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a859f-6ede-43b6-9079-6a551cdb010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:31.918767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a859f-6ede-43b6-9079-6a551cdb010d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:31.919346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a859f-6ede-43b6-9079-6a551cdb010d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:31.919828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a859f-6ede-43b6-9079-6a551cdb010d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:31.921745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a859f-6ede-43b6-9079-6a551cdb010d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:31.923607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a859f-6ede-43b6-9079-6a551cdb010d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:31.943721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 992/1984] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:31.946259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:31.961182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a174c-7378-4667-a956-de49ed5c770a admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:31.974823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:31.975908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:31.977411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:31.977927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] PATH_INFO: `/v3/projects/cc7bf7d3acd541e8a47418f7dc0f64be/users/1107dce296704141af79b37238d93803/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:31.981107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7bf7d3acd541e8a47418f7dc0f64be, user_id=1107dce296704141af79b37238d93803, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:31.984276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:32.008170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 993/1985] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:31 2022] PUT /identity/v3/projects/cc7bf7d3acd541e8a47418f7dc0f64be/users/1107dce296704141af79b37238d93803/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:32.013665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:32.014114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:32.014466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:32.063533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] MFA Rules not processed for user `1107dce296704141af79b37238d93803`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:32.066013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:32.098736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:32.173620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 993/1986] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:32.188204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:32.189955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:32.278433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d04415-d421-4db0-b1b4-04b25c81b9ac admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:32.282399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:32.283081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:32.283373 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:32.283657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:32.295028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:32.296491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:32.307086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 994/1987] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:32.334377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:32.336018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:32.445529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92d2dd-74e7-4107-9ba5-255d35ff7d41 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:32.451217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:32.452356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:32.452863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:32.453280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] PATH_INFO: `/v3/projects/2a050723639d4bb2b06a0c2f29ecc6a0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:32.455109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a050723639d4bb2b06a0c2f29ecc6a0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:32.457471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:32.667003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:32.681133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d99741-00bb-4e47-84f5-0a8cc9429a11 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:32.686247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a050723639d4bb2b06a0c2f29ecc6a0', 'request_id': 'req-3045b7b9-18d9-4a8d-a345-7663e9c298c7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:32.765270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:32.765270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:32.765270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:32.765270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:32.794748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:32.812533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a050723639d4bb2b06a0c2f29ecc6a0', 'request_id': 'req-3045b7b9-18d9-4a8d-a345-7663e9c298c7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:32.820279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a050723639d4bb2b06a0c2f29ecc6a0', 'request_id': 'req-3045b7b9-18d9-4a8d-a345-7663e9c298c7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:32.841906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] The token cache is being invalidate because project 2a050723639d4bb2b06a0c2f29ecc6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:32.842617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:32.843922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:32.859491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 994/1988] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:32 2022] DELETE /identity/v3/projects/2a050723639d4bb2b06a0c2f29ecc6a0 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:32.865936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:32.874670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:32.875961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:32.876555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:32.888729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 995/1989] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:47:33.042859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b7b9-18d9-4a8d-a345-7663e9c298c7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:33.055507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:33.059471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:33.060331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:33.060956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] PATH_INFO: `/v3/users/7a06bb6596574f1f91c7044bc74fa6a8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:33.063764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a06bb6596574f1f91c7044bc74fa6a8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:33.068965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:33.334256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a06bb6596574f1f91c7044bc74fa6a8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:33.337194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a06bb6596574f1f91c7044bc74fa6a8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:33.378669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a06bb6596574f1f91c7044bc74fa6a8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:33.390171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a06bb6596574f1f91c7044bc74fa6a8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:33.391305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a06bb6596574f1f91c7044bc74fa6a8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:33.430386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:33.535418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 995/1990] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:32 2022] DELETE /identity/v3/users/7a06bb6596574f1f91c7044bc74fa6a8 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:34.342383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:34.354715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd9bc-08fc-42e5-aecd-008f074aeee5 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:34.457830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:34.461085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:34.461085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:34.461085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] PATH_INFO: `/v3/projects/7967227d817a44508f3e9555e24ae7fc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:34.461085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7967227d817a44508f3e9555e24ae7fc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:34.463164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:34.663564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7967227d817a44508f3e9555e24ae7fc', 'request_id': 'req-ba420acf-6555-4b3e-a3fa-1226cfd7585f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:34.671066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7967227d817a44508f3e9555e24ae7fc', 'request_id': 'req-ba420acf-6555-4b3e-a3fa-1226cfd7585f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:34.678566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7967227d817a44508f3e9555e24ae7fc', 'request_id': 'req-ba420acf-6555-4b3e-a3fa-1226cfd7585f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:34.803312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] The token cache is being invalidate because project 7967227d817a44508f3e9555e24ae7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:34.803986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:34.805298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:34.816577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 996/1991] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:34 2022] DELETE /identity/v3/projects/7967227d817a44508f3e9555e24ae7fc => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:34.818359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:34.820003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:34.837104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548b18-25c8-401b-940d-8dae85fbfd19 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:34.917670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:34.918177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:34.918479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:34.918761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] PATH_INFO: `/v3/users/4d491538b60d403da08cfef4c4f4f055` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:34.920284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d491538b60d403da08cfef4c4f4f055)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:34.922371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:34.944519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:34.947080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:35.022836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba420acf-6555-4b3e-a3fa-1226cfd7585f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:35.027384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:35.028556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:35.028556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:35.028842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:35.030759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:35.038617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:35.126045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:35.127747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:35.134574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d491538b60d403da08cfef4c4f4f055'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:35.136066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d491538b60d403da08cfef4c4f4f055'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:35.146039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 997/1992] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:35.154909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d491538b60d403da08cfef4c4f4f055'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:35.156513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:35.164811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d491538b60d403da08cfef4c4f4f055'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:35.165571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ed74b0b0-9854-455a-a7f8-5aeea2ac8ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d491538b60d403da08cfef4c4f4f055'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:35.326873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 996/1993] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:34 2022] DELETE /identity/v3/users/4d491538b60d403da08cfef4c4f4f055 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:36.050443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:36.052014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:36.081972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c196-a154-41b2-8756-775524352ec9 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:36.241187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:36.241187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:36.241187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:36.241187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] PATH_INFO: `/v3/projects/7b8085bb175940398fb6fe5912a308ba` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:36.243374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8085bb175940398fb6fe5912a308ba)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:36.248841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:36.424648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8085bb175940398fb6fe5912a308ba', 'request_id': 'req-94312032-1281-47e5-bf34-76b1418be02c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:36.433940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8085bb175940398fb6fe5912a308ba', 'request_id': 'req-94312032-1281-47e5-bf34-76b1418be02c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:36.442423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8085bb175940398fb6fe5912a308ba', 'request_id': 'req-94312032-1281-47e5-bf34-76b1418be02c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:36.562173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] The token cache is being invalidate because project 7b8085bb175940398fb6fe5912a308ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:36.562173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:36.562173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-94312032-1281-47e5-bf34-76b1418be02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:36.562173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 998/1994] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:36 2022] DELETE /identity/v3/projects/7b8085bb175940398fb6fe5912a308ba => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:36.563051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760c72-4710-45b8-8299-dbd47ccfd79c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:36.564273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760c72-4710-45b8-8299-dbd47ccfd79c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:36.566094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760c72-4710-45b8-8299-dbd47ccfd79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:36.616042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1e760c72-4710-45b8-8299-dbd47ccfd79c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:36.617305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1e760c72-4710-45b8-8299-dbd47ccfd79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:36.723799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 997/1995] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:36.733273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faaa6c-0470-43cb-87b5-1b0eaf998005 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:36.733659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faaa6c-0470-43cb-87b5-1b0eaf998005 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:36.733909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faaa6c-0470-43cb-87b5-1b0eaf998005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:36.762899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-15faaa6c-0470-43cb-87b5-1b0eaf998005 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:36.764342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-15faaa6c-0470-43cb-87b5-1b0eaf998005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:36.774052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 999/1996] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:36.778827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e760c72-4710-45b8-8299-dbd47ccfd79c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:36.791335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e760c72-4710-45b8-8299-dbd47ccfd79c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:36.798222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:36.799011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:36.799312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:36.800425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:36.800425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:36.800692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:36.803606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:36.826210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 998/1997] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:47:36.827673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faaa6c-0470-43cb-87b5-1b0eaf998005 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:36.839861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faaa6c-0470-43cb-87b5-1b0eaf998005 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:36.848903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:36.850167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:36.850562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:36.851077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:36.853130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:36.858444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:36.989331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1000/1998] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:36 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:36.993571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:37.005281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a6499-90d1-4ac5-8b26-d782b8145468 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:37.097834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:37.098623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:37.099027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:37.099353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:37.100371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:37.102616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:37.258924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 999/1999] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:36 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:37.266555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:37.285496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:37.290383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab695-3b10-468b-9d4c-6df2392433aa admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:37.297094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:37.297923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:37.298276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:37.298829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:37.299699 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:37.301831 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:37.317123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1001/2000] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:37.327161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:37.345244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359721-a8f0-408e-b7a8-d41a6814efb2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:37.358368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96035-5640-41eb-b0fa-4b7d48e011ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:37.358368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96035-5640-41eb-b0fa-4b7d48e011ec admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:37.358368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96035-5640-41eb-b0fa-4b7d48e011ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:37.358368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96035-5640-41eb-b0fa-4b7d48e011ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:37.359610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96035-5640-41eb-b0fa-4b7d48e011ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:37.362551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96035-5640-41eb-b0fa-4b7d48e011ec admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:37.393762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1000/2001] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:37.396639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:37.409362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8e28b-8837-4778-a458-aaef5cdeff8d admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:37.423481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:37.424078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:37.424369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:37.424652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] PATH_INFO: `/v3/projects/a1fe5b6f274d4a39a51d207ef0dc428a/users/dedb59f2ef524c849ca29a265bd46373/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:37.449998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fe5b6f274d4a39a51d207ef0dc428a, user_id=dedb59f2ef524c849ca29a265bd46373, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:37.455452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:37.586334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1002/2002] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:37 2022] PUT /identity/v3/projects/a1fe5b6f274d4a39a51d207ef0dc428a/users/dedb59f2ef524c849ca29a265bd46373/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:37.601760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a3fc-1bc2-445d-9f86-9ba379682f0f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:37.602386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a3fc-1bc2-445d-9f86-9ba379682f0f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:37.602386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a3fc-1bc2-445d-9f86-9ba379682f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:37.633861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9d59a3fc-1bc2-445d-9f86-9ba379682f0f None None] MFA Rules not processed for user `dedb59f2ef524c849ca29a265bd46373`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:37.635115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9d59a3fc-1bc2-445d-9f86-9ba379682f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:37.729105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:37.783871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1001/2003] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:37.785813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:37.989667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c4b9-7dda-4b5b-89aa-818d5d79962c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:38.004533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:38.006085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:38.006546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:38.006797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:38.008061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:38.010766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:38.171160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1003/2004] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:37 2022] POST /identity/v3/projects => generated 387 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:38.176536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a3fc-1bc2-445d-9f86-9ba379682f0f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:38.189310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a3fc-1bc2-445d-9f86-9ba379682f0f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:38.350598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:38.351400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:38.351792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:38.352913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:38.352913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:38.355909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:38.494415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1002/2005] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:38 2022] POST /identity/v3/users => generated 300 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:38.501437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:38.529208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61de567-639d-4c14-bcff-d846d53ef2f2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:38.538585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:38.539702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:38.540206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:38.545473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:38.545473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:38.546738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:38.596199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1004/2006] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:38.604109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:38.628950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21538d-a992-451e-86bc-bb0110f18bba admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:38.638921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:38.641105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:38.642563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:38.643340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] PATH_INFO: `/v3/projects/b4f5e26cd28e49ef933a6868f771ed32/users/97cf068245464714b1201c77ee3ccf8d/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:38.679289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f5e26cd28e49ef933a6868f771ed32, user_id=97cf068245464714b1201c77ee3ccf8d, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:38.687449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:38.783932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1003/2007] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:38 2022] PUT /identity/v3/projects/b4f5e26cd28e49ef933a6868f771ed32/users/97cf068245464714b1201c77ee3ccf8d/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:38.788432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:38.804898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f886-78ad-4ff4-a9d8-30fea2a55dcb admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:38.944147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb811044-da20-41d5-8786-64f39b76247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:38.944733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb811044-da20-41d5-8786-64f39b76247c admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:38.945023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb811044-da20-41d5-8786-64f39b76247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:38.945337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb811044-da20-41d5-8786-64f39b76247c admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:38.946188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb811044-da20-41d5-8786-64f39b76247c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:38.950424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb811044-da20-41d5-8786-64f39b76247c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:38.966987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1005/2008] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:38.968199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:38.980183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc81a-eee0-4880-ae78-4b3290d47475 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:38.985305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:38.986362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:38.986656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:38.986938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] PATH_INFO: `/v3/projects/b4f5e26cd28e49ef933a6868f771ed32/users/97cf068245464714b1201c77ee3ccf8d/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:38.990641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f5e26cd28e49ef933a6868f771ed32, user_id=97cf068245464714b1201c77ee3ccf8d, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:38.995381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:39.019444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1004/2009] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:38 2022] PUT /identity/v3/projects/b4f5e26cd28e49ef933a6868f771ed32/users/97cf068245464714b1201c77ee3ccf8d/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:39.038174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba659f9-3a21-40b7-9a24-068139ede7cf None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:39.038606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba659f9-3a21-40b7-9a24-068139ede7cf None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:39.039205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba659f9-3a21-40b7-9a24-068139ede7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:39.084530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bba659f9-3a21-40b7-9a24-068139ede7cf None None] MFA Rules not processed for user `97cf068245464714b1201c77ee3ccf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:39.086392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bba659f9-3a21-40b7-9a24-068139ede7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:39.149317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:39.208552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1006/2010] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:39.255833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:39.258138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:39.352454 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743f23-4931-4048-b761-4a63d245bb70 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:39.360876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852299e7-ac0f-4195-b0d5-05975fe74098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:39.360876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852299e7-ac0f-4195-b0d5-05975fe74098 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:39.360876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852299e7-ac0f-4195-b0d5-05975fe74098 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:39.360876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852299e7-ac0f-4195-b0d5-05975fe74098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:39.377954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852299e7-ac0f-4195-b0d5-05975fe74098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:39.379744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852299e7-ac0f-4195-b0d5-05975fe74098 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:39.396139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1005/2011] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:41.815610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba659f9-3a21-40b7-9a24-068139ede7cf None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:41.915573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba659f9-3a21-40b7-9a24-068139ede7cf None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:41.921596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:41.922132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:41.922429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:41.922714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] PATH_INFO: `/v3/users/dedb59f2ef524c849ca29a265bd46373` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:41.924030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedb59f2ef524c849ca29a265bd46373)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:41.926092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:42.201942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedb59f2ef524c849ca29a265bd46373'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:42.202530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedb59f2ef524c849ca29a265bd46373'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:42.215125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedb59f2ef524c849ca29a265bd46373'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:42.222571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedb59f2ef524c849ca29a265bd46373'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:42.223529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedb59f2ef524c849ca29a265bd46373'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:42.350147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1007/2012] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:41 2022] DELETE /identity/v3/users/dedb59f2ef524c849ca29a265bd46373 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:42.355504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862e02-e231-4511-8617-64346e8b2750 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:42.356294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862e02-e231-4511-8617-64346e8b2750 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:42.356294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862e02-e231-4511-8617-64346e8b2750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:42.379617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-12862e02-e231-4511-8617-64346e8b2750 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:42.380850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-12862e02-e231-4511-8617-64346e8b2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:42.411231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:42.443083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1006/2013] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:42.453628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:42.455395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:42.544179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:42.563486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00530513-8f6d-4d57-af4b-6f7b98b47929 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:42.567353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:42.568048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:42.568335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:42.568613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:42.584481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:42.586218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:42.597905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1008/2014] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:43.040775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12862e02-e231-4511-8617-64346e8b2750 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:43.043236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-12862e02-e231-4511-8617-64346e8b2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.056445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12862e02-e231-4511-8617-64346e8b2750 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:43.061794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:43.065349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.065785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.066070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] PATH_INFO: `/v3/users/67e28ab6de7d49da8dcebaca85009802` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.067518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e28ab6de7d49da8dcebaca85009802)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:43.071274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:43.092624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:43.092624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.105415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df5a79-4afe-453e-b5e6-1929460aa334 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:43.110679 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:43.111582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.111871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.112496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] PATH_INFO: `/v3/users/9ff63693fcda4b47b3296407d254a47d` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.114119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff63693fcda4b47b3296407d254a47d)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:43.116137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:43.349231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e28ab6de7d49da8dcebaca85009802'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.349946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e28ab6de7d49da8dcebaca85009802'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.362614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e28ab6de7d49da8dcebaca85009802'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.371083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e28ab6de7d49da8dcebaca85009802'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.371827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e28ab6de7d49da8dcebaca85009802'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.394223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff63693fcda4b47b3296407d254a47d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.394955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff63693fcda4b47b3296407d254a47d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.408707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff63693fcda4b47b3296407d254a47d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.416256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff63693fcda4b47b3296407d254a47d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.417074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e9285267-c666-44bf-a5bb-2c7709772fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff63693fcda4b47b3296407d254a47d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.461614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1007/2015] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:43 2022] DELETE /identity/v3/users/67e28ab6de7d49da8dcebaca85009802 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:43.463077 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:43.465852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.547963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28de2-03fc-4d73-bdcf-43791a9f9150 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:43.560007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1009/2016] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:43 2022] DELETE /identity/v3/users/9ff63693fcda4b47b3296407d254a47d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:43.560244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:43.560244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.560439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317fb42-b5df-47af-a12c-298ac3f6766c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.560525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.560610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317fb42-b5df-47af-a12c-298ac3f6766c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.560726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] PATH_INFO: `/v3/projects/a1fe5b6f274d4a39a51d207ef0dc428a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.560817 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317fb42-b5df-47af-a12c-298ac3f6766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.560937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fe5b6f274d4a39a51d207ef0dc428a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:43.562968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:43.579355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7317fb42-b5df-47af-a12c-298ac3f6766c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:43.580597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7317fb42-b5df-47af-a12c-298ac3f6766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.654999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1010/2017] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:43.656690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.656902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.657223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.677606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:43.678874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.688569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1011/2018] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:43.690030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:43.691533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.721914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:43.728509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fe5b6f274d4a39a51d207ef0dc428a', 'request_id': 'req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.762965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fd343-f7f7-47d8-bbd6-bf4cda1fedd3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:43.767893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:43.821260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:43.821260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.821260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.821260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.845984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fe5b6f274d4a39a51d207ef0dc428a', 'request_id': 'req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.853227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fe5b6f274d4a39a51d207ef0dc428a', 'request_id': 'req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.866843 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] The token cache is being invalidate because project a1fe5b6f274d4a39a51d207ef0dc428a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:43.867138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.867825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:43.869523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1008/2019] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:43 2022] DELETE /identity/v3/projects/a1fe5b6f274d4a39a51d207ef0dc428a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:43.870505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:43.872220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.884094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a82b6-3687-4f9b-bde2-df28d89c10e7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:43.885788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:43.886752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:43.888490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:43.889150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.889421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.889722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.891513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.896447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1012/2020] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:43.897240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:43.898688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:43.911934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201e73f-3c2c-4cad-96e8-702e3e9f57d3 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:43.918089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:43.918982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:43.919264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:43.919761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] PATH_INFO: `/v3/users/97cf068245464714b1201c77ee3ccf8d` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:43.920863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cf068245464714b1201c77ee3ccf8d)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:43.922940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:43.930969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:43.932534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:43.944426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1009/2021] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:44.192677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cf068245464714b1201c77ee3ccf8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:44.194063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cf068245464714b1201c77ee3ccf8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:44.214225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cf068245464714b1201c77ee3ccf8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:44.222621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cf068245464714b1201c77ee3ccf8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:44.223397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cf068245464714b1201c77ee3ccf8d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:44.584416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1013/2022] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:43 2022] DELETE /identity/v3/users/97cf068245464714b1201c77ee3ccf8d => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:44.804148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:44.806514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:44.815812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:44.816069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:44.848105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed5cf2-030d-46a5-9107-e0540cc760d1 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:44.950430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256e2d-deae-40a0-b2f3-0ee1483e4a52 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:44.955538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:44.956475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:44.956827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:44.957169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] PATH_INFO: `/v3/projects/408358db177e4ee9a179b334f295bb6f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:44.958453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408358db177e4ee9a179b334f295bb6f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:44.960412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:44.970181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:44.971067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:44.971370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:44.971656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] PATH_INFO: `/v3/projects/03fee300103a4f08a3577097d44ffad2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:44.972973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fee300103a4f08a3577097d44ffad2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:44.975020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:45.167719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408358db177e4ee9a179b334f295bb6f', 'request_id': 'req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.174267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408358db177e4ee9a179b334f295bb6f', 'request_id': 'req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.179131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fee300103a4f08a3577097d44ffad2', 'request_id': 'req-6fc025d4-5335-4eb7-ae7b-466de31d2318'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.181712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408358db177e4ee9a179b334f295bb6f', 'request_id': 'req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.253010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:45.298481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fee300103a4f08a3577097d44ffad2', 'request_id': 'req-6fc025d4-5335-4eb7-ae7b-466de31d2318'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.305239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fee300103a4f08a3577097d44ffad2', 'request_id': 'req-6fc025d4-5335-4eb7-ae7b-466de31d2318'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.317544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] The token cache is being invalidate because project 03fee300103a4f08a3577097d44ffad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:45.317874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.318544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.320189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1010/2023] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:44 2022] DELETE /identity/v3/projects/03fee300103a4f08a3577097d44ffad2 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:45.325341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:45.327155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:45.390826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:45.400313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] The token cache is being invalidate because project 408358db177e4ee9a179b334f295bb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:45.401623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.403053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.406163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1014/2024] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:44 2022] DELETE /identity/v3/projects/408358db177e4ee9a179b334f295bb6f => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:45.412533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:45.414508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:45.416691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc025d4-5335-4eb7-ae7b-466de31d2318 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:45.423872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:45.424863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:45.425253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:45.425609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] PATH_INFO: `/v3/users/43ddb1b08157455dbcb0f38f110a24fc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:45.427003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ddb1b08157455dbcb0f38f110a24fc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:45.429399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:45.498904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0b31d-b171-45b6-9fee-21cbdfcd5538 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:45.505915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:45.505915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:45.505915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:45.505915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] PATH_INFO: `/v3/projects/b4f5e26cd28e49ef933a6868f771ed32` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:45.511949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f5e26cd28e49ef933a6868f771ed32)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:45.518477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:45.639080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ddb1b08157455dbcb0f38f110a24fc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.640252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ddb1b08157455dbcb0f38f110a24fc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.660879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ddb1b08157455dbcb0f38f110a24fc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.679358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ddb1b08157455dbcb0f38f110a24fc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.679588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f5e26cd28e49ef933a6868f771ed32', 'request_id': 'req-1e28e19e-80ad-4e4a-96f1-86496faf6cba'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.681886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ddb1b08157455dbcb0f38f110a24fc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.690159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f5e26cd28e49ef933a6868f771ed32', 'request_id': 'req-1e28e19e-80ad-4e4a-96f1-86496faf6cba'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.704159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f5e26cd28e49ef933a6868f771ed32', 'request_id': 'req-1e28e19e-80ad-4e4a-96f1-86496faf6cba'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.800018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1011/2025] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:45 2022] DELETE /identity/v3/users/43ddb1b08157455dbcb0f38f110a24fc => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:45.801551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:45.804733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:45.876366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] The token cache is being invalidate because project b4f5e26cd28e49ef933a6868f771ed32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:45.876673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.877482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-1e28e19e-80ad-4e4a-96f1-86496faf6cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:45.879419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1015/2026] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:45 2022] DELETE /identity/v3/projects/b4f5e26cd28e49ef933a6868f771ed32 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:45.886833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146913-1b72-4335-970a-a335d90b9ca1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:45.887132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146913-1b72-4335-970a-a335d90b9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:45.887413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146913-1b72-4335-970a-a335d90b9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:45.908405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad167-dbf9-42c3-877c-df36480c8139 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:45.919405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:45.920241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d2146913-1b72-4335-970a-a335d90b9ca1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:45.920433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:45.920764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:45.921050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] PATH_INFO: `/v3/users/1107dce296704141af79b37238d93803` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:45.921565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d2146913-1b72-4335-970a-a335d90b9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:45.923255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1107dce296704141af79b37238d93803)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:45.925846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:45.938293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1016/2027] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:45.945136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979016a7-d227-478d-8b14-21c6e21c7fd3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:45.946837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979016a7-d227-478d-8b14-21c6e21c7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:45.947132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979016a7-d227-478d-8b14-21c6e21c7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:45.978040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-979016a7-d227-478d-8b14-21c6e21c7fd3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:45.980234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-979016a7-d227-478d-8b14-21c6e21c7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:45.995166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1017/2028] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:45.995166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979016a7-d227-478d-8b14-21c6e21c7fd3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:46.005774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979016a7-d227-478d-8b14-21c6e21c7fd3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:46.011349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:46.012527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:46.012527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:46.012742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:46.013451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:46.013797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:46.015463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:46.036120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1018/2029] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:46.041073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:46.060595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcae354-0fae-4aa6-b0b8-02ec0f806b23 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:46.069348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:46.070627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:46.071130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:46.071449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:46.072166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:46.074360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:46.209717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1019/2030] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:46 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:46.212923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:46.292721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1107dce296704141af79b37238d93803'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.294163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1107dce296704141af79b37238d93803'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.324394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1107dce296704141af79b37238d93803'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.331371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a287-ed42-4b00-a728-acb82585f78b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:46.334806 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1107dce296704141af79b37238d93803'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.335547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1107dce296704141af79b37238d93803'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.344172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:46.344879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:46.345178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:46.345445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:46.346198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:46.349626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:46.465612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1012/2031] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:45 2022] DELETE /identity/v3/users/1107dce296704141af79b37238d93803 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:46.496590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1020/2032] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:46 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:46.501976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:46.507136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:46.522445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:46.682287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47568015-59e8-4522-89e6-4519487ef54c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:46.686904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:46.687825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:46.688193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:46.688654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:46.689604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:46.692226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:46.707684 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:46.709656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:46.717459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:46.727355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1013/2033] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:46.735940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:46.743320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bfd92-97b8-46ae-aad8-a298a89eaf3b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:46.749660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:46.755745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:46.755745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:46.755745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] PATH_INFO: `/v3/projects/54e0bebbfc664b2cb37df03f52c0deb3` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:46.755745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e0bebbfc664b2cb37df03f52c0deb3)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:46.760080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:46.775497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8375e4-f208-4392-b1f9-7d67860d00f1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:46.788073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:46.790267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:46.790267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:46.790267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:46.790629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:46.792989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:46.826577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1014/2034] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:46.831840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:46.848217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df5ca2-9f2b-48a7-b774-36254f9679e8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:46.855553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8c13d-4df0-4d4f-9e24-9eaa80541703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:46.857824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8c13d-4df0-4d4f-9e24-9eaa80541703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:46.858089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8c13d-4df0-4d4f-9e24-9eaa80541703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:46.858374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8c13d-4df0-4d4f-9e24-9eaa80541703 admin admin] PATH_INFO: `/v3/projects/da406180feef46568d5f190624bd6947/users/3434dd0c069943e096743781032081b1/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:46.897747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8c13d-4df0-4d4f-9e24-9eaa80541703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da406180feef46568d5f190624bd6947, user_id=3434dd0c069943e096743781032081b1, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:46.902160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8c13d-4df0-4d4f-9e24-9eaa80541703 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:46.954834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e0bebbfc664b2cb37df03f52c0deb3', 'request_id': 'req-42d69657-6bcb-4f6d-b08b-216b728a9782'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.968944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e0bebbfc664b2cb37df03f52c0deb3', 'request_id': 'req-42d69657-6bcb-4f6d-b08b-216b728a9782'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.983951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e0bebbfc664b2cb37df03f52c0deb3', 'request_id': 'req-42d69657-6bcb-4f6d-b08b-216b728a9782'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:46.999883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1015/2035] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:46 2022] PUT /identity/v3/projects/da406180feef46568d5f190624bd6947/users/3434dd0c069943e096743781032081b1/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:47.012108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.012108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.012108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.068926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] MFA Rules not processed for user `3434dd0c069943e096743781032081b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:47.071599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:47.144382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] The token cache is being invalidate because project 54e0bebbfc664b2cb37df03f52c0deb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:47.144909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:47.145905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-42d69657-6bcb-4f6d-b08b-216b728a9782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:47.149803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1021/2036] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:46 2022] DELETE /identity/v3/projects/54e0bebbfc664b2cb37df03f52c0deb3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:47.156992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b03ea-5d71-478a-8cda-a81b79f1fbb3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.168120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b03ea-5d71-478a-8cda-a81b79f1fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.168120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b03ea-5d71-478a-8cda-a81b79f1fbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.169007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1016/2037] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:47.174819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:47.177468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:47.203410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3f2b03ea-5d71-478a-8cda-a81b79f1fbb3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:47.204416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3f2b03ea-5d71-478a-8cda-a81b79f1fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:47.264409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966690-7529-46e5-8c90-f64a9ad68235 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:47.271110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765f3f-f56e-43eb-b82c-a093a14ad11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:47.272112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765f3f-f56e-43eb-b82c-a093a14ad11b service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.272582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765f3f-f56e-43eb-b82c-a093a14ad11b service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.273016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765f3f-f56e-43eb-b82c-a093a14ad11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.282468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-52765f3f-f56e-43eb-b82c-a093a14ad11b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:47.288279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765f3f-f56e-43eb-b82c-a093a14ad11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:47.290099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765f3f-f56e-43eb-b82c-a093a14ad11b service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:47.302928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1017/2038] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:47.325420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1022/2039] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:47.336732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c352-cae6-425d-a693-f53a90da234e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.337109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c352-cae6-425d-a693-f53a90da234e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.337497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c352-cae6-425d-a693-f53a90da234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.362157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2255c352-cae6-425d-a693-f53a90da234e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:47.364201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2255c352-cae6-425d-a693-f53a90da234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:47.378001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1018/2040] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:47.381957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b03ea-5d71-478a-8cda-a81b79f1fbb3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:47.396938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b03ea-5d71-478a-8cda-a81b79f1fbb3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:47.405871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:47.406617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.406905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.407184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.407935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:47.408247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:47.410820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:47.432789 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1023/2041] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:47:47.437145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c352-cae6-425d-a693-f53a90da234e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:47.445657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c352-cae6-425d-a693-f53a90da234e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:47.463580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:47.464609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.464893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.465164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.465920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:47.467998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:47.574949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1019/2042] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:47 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:47.579713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:47.591964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0c378-bbc8-4ed2-9852-95eeda2465df admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:47.654460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:47.657189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:47.707159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:47.707159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.708981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.708981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.708981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:47.713995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:47.773799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862733-8960-411b-b87c-1b5a5b7c1d31 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:47.778801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:47.779673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.779961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.780238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] PATH_INFO: `/v3/projects/cc7bf7d3acd541e8a47418f7dc0f64be` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.781480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7bf7d3acd541e8a47418f7dc0f64be)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:47.783551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:47.862809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1024/2043] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:47 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:47.869036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:47.886024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352e4d-100d-44fe-b211-25de28275208 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:47.894187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:47.898964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.898964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.898964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.898964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:47.900921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:47.913778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1025/2044] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:47.918683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:47.928859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea606e-d0d8-4785-8002-7f3b12a15f02 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:47.940318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7bf7d3acd541e8a47418f7dc0f64be', 'request_id': 'req-28ace305-649c-4c55-938c-aa81dd31817c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:47.996364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:47.998252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:47.998252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:47.998252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:47.998714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.000044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.010954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1026/2045] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:48.015397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.025542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7849b-0a19-4fa1-8e0b-a4154b0bad47 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.032180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3636-0695-4cd8-8ab5-1c28325d4de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.032180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3636-0695-4cd8-8ab5-1c28325d4de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.032580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3636-0695-4cd8-8ab5-1c28325d4de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.032727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3636-0695-4cd8-8ab5-1c28325d4de9 admin admin] PATH_INFO: `/v3/projects/9362ff24f2ec45559f3d77865cd04363/users/f482696722db4b668b1d88fc87444fe5/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.050033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3636-0695-4cd8-8ab5-1c28325d4de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9362ff24f2ec45559f3d77865cd04363, user_id=f482696722db4b668b1d88fc87444fe5, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.052722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7bf7d3acd541e8a47418f7dc0f64be', 'request_id': 'req-28ace305-649c-4c55-938c-aa81dd31817c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:48.056833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3636-0695-4cd8-8ab5-1c28325d4de9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.060484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7bf7d3acd541e8a47418f7dc0f64be', 'request_id': 'req-28ace305-649c-4c55-938c-aa81dd31817c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:48.074158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] The token cache is being invalidate because project cc7bf7d3acd541e8a47418f7dc0f64be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:48.074520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:48.075198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28ace305-649c-4c55-938c-aa81dd31817c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:48.077070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1020/2046] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:47 2022] DELETE /identity/v3/projects/cc7bf7d3acd541e8a47418f7dc0f64be => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:48.082977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85b0d5-6275-4cca-a8ae-03a6715e52d7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.083315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85b0d5-6275-4cca-a8ae-03a6715e52d7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.083737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85b0d5-6275-4cca-a8ae-03a6715e52d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.109894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-dc85b0d5-6275-4cca-a8ae-03a6715e52d7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:48.112202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dc85b0d5-6275-4cca-a8ae-03a6715e52d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:48.127057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1021/2047] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:48.145241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732bef-8944-4e0d-ab16-2f4714133ba6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.145616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732bef-8944-4e0d-ab16-2f4714133ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.145982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732bef-8944-4e0d-ab16-2f4714133ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.172841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8a732bef-8944-4e0d-ab16-2f4714133ba6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:48.175078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8a732bef-8944-4e0d-ab16-2f4714133ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:48.192113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1022/2048] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:48.201952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a732bef-8944-4e0d-ab16-2f4714133ba6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.208319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a732bef-8944-4e0d-ab16-2f4714133ba6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.221553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.222431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.222722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.223999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.225207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:48.225207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.226818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1027/2049] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:48 2022] PUT /identity/v3/projects/9362ff24f2ec45559f3d77865cd04363/users/f482696722db4b668b1d88fc87444fe5/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:48.227445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.240683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.240980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.241259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.261815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1023/2050] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:47:48.265951 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.290347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc39a66-f10a-4e7d-b9bc-0047758bd505 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.331629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] MFA Rules not processed for user `f482696722db4b668b1d88fc87444fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:48.333458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:48.344361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:INSERT=6,keystone:DELETE=8,keystone:SELECT=86 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:48.405136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.405867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.406165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.406635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.408014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.409298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.430900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1028/2051] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:48.443124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.444548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:48.506681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a78ec-2582-4584-8ffc-0bc0a7e74436 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.525962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.525962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.525962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.525962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.529533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.531064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.541301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1029/2052] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:47:48.551910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1024/2053] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:48 2022] POST /identity/v3/projects => generated 373 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:48.555349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.567342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389660a-5485-4273-8b1d-cd534540016f service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.647675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.649026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.649648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.650081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.651999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.654711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:48.655271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.816981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1030/2054] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:48 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:48.818767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.833321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e7c96-b55f-4d08-9ff6-29387c8ee55a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.838798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.839707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.840073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.840424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.841270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.843065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.853786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1025/2055] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:48.859001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.869935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009bf6-d2dc-4382-9edb-0c4ed712b951 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.874891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259af09-9a71-47d6-ada5-185723eb6274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.875583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259af09-9a71-47d6-ada5-185723eb6274 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.875870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259af09-9a71-47d6-ada5-185723eb6274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.876157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259af09-9a71-47d6-ada5-185723eb6274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.876903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259af09-9a71-47d6-ada5-185723eb6274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.878666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259af09-9a71-47d6-ada5-185723eb6274 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:48.890087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1031/2056] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:48.893953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:48.905533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f221-30d3-456f-8969-81864c9cc32b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:48.910746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:48.912128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:48.912128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:48.912362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] PATH_INFO: `/v3/projects/46315203851a47a2a52967da055ffe65/users/30afe2c87b874ca2a955e733793589f0/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:48.928804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46315203851a47a2a52967da055ffe65, user_id=30afe2c87b874ca2a955e733793589f0, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:48.931686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:49.084057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1026/2057] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:48 2022] PUT /identity/v3/projects/46315203851a47a2a52967da055ffe65/users/30afe2c87b874ca2a955e733793589f0/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:49.095370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5eda-5708-4b2d-beb3-c3c0e2987126 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:49.095662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5eda-5708-4b2d-beb3-c3c0e2987126 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:49.095944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5eda-5708-4b2d-beb3-c3c0e2987126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:49.133337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b47b5eda-5708-4b2d-beb3-c3c0e2987126 None None] MFA Rules not processed for user `30afe2c87b874ca2a955e733793589f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:49.135773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b47b5eda-5708-4b2d-beb3-c3c0e2987126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:49.205019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1032/2058] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:49.210575 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:49.286433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9e13-f2d7-4cef-843d-fd150d1baa7a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:49.294072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:49.295818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:49.295818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:49.295818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:49.296436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:49.298561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:49.411693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1027/2059] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:49 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:47:49.418171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b5eda-5708-4b2d-beb3-c3c0e2987126 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:49.430383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b5eda-5708-4b2d-beb3-c3c0e2987126 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:49.500780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:49.502079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:49.502635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:49.503143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:49.504449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:49.508335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:49.672046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1033/2060] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:49 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:49.677815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:49.701082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2bae-1d99-4380-959d-9113f5ab468e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:49.701293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:49.702041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:49.702412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:49.702600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:49.703356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:49.704998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:49.720193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1028/2061] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:49.722458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:49.735084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba82bb6-0d55-48bf-8877-582f4b467786 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:49.741325 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:49.742547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:49.743106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:49.743106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] PATH_INFO: `/v3/projects/9aeee6d2ee6b4eff9ddc71a8ba490a4c/users/6f8279d07076413e9b85d0740c3aa39d/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:49.760898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeee6d2ee6b4eff9ddc71a8ba490a4c, user_id=6f8279d07076413e9b85d0740c3aa39d, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:49.763952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:49.870996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1034/2062] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:49 2022] PUT /identity/v3/projects/9aeee6d2ee6b4eff9ddc71a8ba490a4c/users/6f8279d07076413e9b85d0740c3aa39d/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:49.875220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:49.886367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec948d-c64f-4f56-a9a2-ae81d5d3b4f5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:49.952063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f363fb4-58c7-4395-9068-8f874bc3ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:49.952647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f363fb4-58c7-4395-9068-8f874bc3ac65 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:49.952936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f363fb4-58c7-4395-9068-8f874bc3ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:49.953216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f363fb4-58c7-4395-9068-8f874bc3ac65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:49.954200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f363fb4-58c7-4395-9068-8f874bc3ac65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:49.955710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f363fb4-58c7-4395-9068-8f874bc3ac65 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:49.967042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1029/2063] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:49.971403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:49.982951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf94e-f47b-4346-b64d-c3195e30e0da admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:49.987820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:49.988763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:49.989042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:49.989312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] PATH_INFO: `/v3/projects/9aeee6d2ee6b4eff9ddc71a8ba490a4c/users/6f8279d07076413e9b85d0740c3aa39d/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:49.991894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeee6d2ee6b4eff9ddc71a8ba490a4c, user_id=6f8279d07076413e9b85d0740c3aa39d, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:49.994336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:50.006003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1035/2064] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:49 2022] PUT /identity/v3/projects/9aeee6d2ee6b4eff9ddc71a8ba490a4c/users/6f8279d07076413e9b85d0740c3aa39d/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:50.016713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56e29b-7775-470d-bb07-3ec138d39183 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:50.017011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56e29b-7775-470d-bb07-3ec138d39183 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:50.017286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56e29b-7775-470d-bb07-3ec138d39183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:50.050156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7d56e29b-7775-470d-bb07-3ec138d39183 None None] MFA Rules not processed for user `6f8279d07076413e9b85d0740c3aa39d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:50.051526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7d56e29b-7775-470d-bb07-3ec138d39183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:50.142819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1030/2065] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:50.163898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:50.229964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecd9ee-dcdb-4e37-bf2c-69f7a44ddf99 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:50.234129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:50.235094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:50.235385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:50.235667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:50.302583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:50.304163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:50.315779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1036/2066] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:50.317341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:50.464790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6d45-3ed2-4db9-9807-f776a821ec2f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:50.465342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6d45-3ed2-4db9-9807-f776a821ec2f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:50.465849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6d45-3ed2-4db9-9807-f776a821ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:50.485957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a55a6d45-3ed2-4db9-9807-f776a821ec2f None None] MFA Rules not processed for user `3434dd0c069943e096743781032081b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:50.487113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a55a6d45-3ed2-4db9-9807-f776a821ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:50.577127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1031/2067] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:50.625443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:51.243755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:51.864675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:52.401998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:53.754536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:53.757528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:53.892139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860cc3-99c9-4b4b-9099-b665b7af9485 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:53.909221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:53.909221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:53.909221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:53.909221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] PATH_INFO: `/v3/users/f482696722db4b668b1d88fc87444fe5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:53.909925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f482696722db4b668b1d88fc87444fe5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:53.909925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:54.269608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f482696722db4b668b1d88fc87444fe5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.270402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f482696722db4b668b1d88fc87444fe5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.288153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f482696722db4b668b1d88fc87444fe5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.297226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f482696722db4b668b1d88fc87444fe5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.297996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f482696722db4b668b1d88fc87444fe5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.423561 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1037/2068] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:53 2022] DELETE /identity/v3/users/f482696722db4b668b1d88fc87444fe5 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:54.425727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:54.427462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:54.427787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:54.451642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:54.452922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:54.534009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1032/2069] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:54.560239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:54.563066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:54.564473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:54.567277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:54.589606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeeb0b-a75a-4574-9065-81086eab3eea admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:54.589773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:54.596108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:54.597113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:54.597407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:54.597723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] PATH_INFO: `/v3/users/15192fcc0e02436b90c73fdc284b2e71` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:54.599170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15192fcc0e02436b90c73fdc284b2e71)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:54.601184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:54.629910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:54.667500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3101b-13d2-4a16-a81c-7504da06f60b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:54.671867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b711dd-1072-442f-9d81-9dfc4ebc5a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:54.672548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b711dd-1072-442f-9d81-9dfc4ebc5a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:54.672834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b711dd-1072-442f-9d81-9dfc4ebc5a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:54.673111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b711dd-1072-442f-9d81-9dfc4ebc5a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:54.684055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b711dd-1072-442f-9d81-9dfc4ebc5a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:54.685546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b711dd-1072-442f-9d81-9dfc4ebc5a37 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:54.707259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1033/2070] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:47:54.933862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15192fcc0e02436b90c73fdc284b2e71'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.934577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15192fcc0e02436b90c73fdc284b2e71'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.967736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15192fcc0e02436b90c73fdc284b2e71'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.979977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15192fcc0e02436b90c73fdc284b2e71'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:54.981949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15192fcc0e02436b90c73fdc284b2e71'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:55.118382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1038/2071] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:54 2022] DELETE /identity/v3/users/15192fcc0e02436b90c73fdc284b2e71 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:55.127094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:55.127094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:55.127094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:55.154088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:55.156248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:55.162412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:55.165164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:55.333561 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0427d18-5e23-475b-829b-15da630e6fc6 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:55.343452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:55.345242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:55.346167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:55.346839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] PATH_INFO: `/v3/users/30afe2c87b874ca2a955e733793589f0` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:55.350514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30afe2c87b874ca2a955e733793589f0)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:55.353049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:55.367507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1034/2072] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:55.381877 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:55.383786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:55.505566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063c6c-b321-446b-b1e9-c2f5637d7116 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:55.513555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:55.515511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:55.516022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:55.516541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:55.535603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:55.538375 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:55.562209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1035/2073] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:47:55.616518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:55.616518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:55.632390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e13d3-423a-4872-8b23-b698f6f7390a service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:55.640758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:55.644126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:55.646121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:55.652975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] PATH_INFO: `/v3/projects/9362ff24f2ec45559f3d77865cd04363` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:55.652975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9362ff24f2ec45559f3d77865cd04363)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:55.657730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:55.704136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30afe2c87b874ca2a955e733793589f0'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:55.705813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30afe2c87b874ca2a955e733793589f0'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:55.731088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30afe2c87b874ca2a955e733793589f0'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:55.739858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30afe2c87b874ca2a955e733793589f0'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:55.740603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-212f782b-157e-41a1-a877-2b9ed6eb4075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30afe2c87b874ca2a955e733793589f0'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:55.884219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1039/2074] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:55 2022] DELETE /identity/v3/users/30afe2c87b874ca2a955e733793589f0 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:55.890315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:55.890708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:55.892703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:55.932563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9362ff24f2ec45559f3d77865cd04363', 'request_id': 'req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:55.940883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:55.949795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:55.953778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:55.968472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:56.018393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9362ff24f2ec45559f3d77865cd04363', 'request_id': 'req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:56.026101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9362ff24f2ec45559f3d77865cd04363', 'request_id': 'req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:56.054352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] The token cache is being invalidate because project 9362ff24f2ec45559f3d77865cd04363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:56.054352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:56.055933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2958b6bb-c1ac-4c37-a06a-db042bf9b39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:56.066128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1036/2075] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:55 2022] DELETE /identity/v3/projects/9362ff24f2ec45559f3d77865cd04363 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:56.069163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f20abc-dc3d-47ee-837e-9fba68173a18 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.069163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f20abc-dc3d-47ee-837e-9fba68173a18 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.069417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f20abc-dc3d-47ee-837e-9fba68173a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.095059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1040/2076] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:56.121294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d8f20abc-dc3d-47ee-837e-9fba68173a18 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:56.124905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d8f20abc-dc3d-47ee-837e-9fba68173a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:56.148148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:56.149065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1037/2077] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:56.160669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:56.161039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331297-f1c4-4f01-9550-9b3fe04c3611 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.162302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331297-f1c4-4f01-9550-9b3fe04c3611 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.162617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331297-f1c4-4f01-9550-9b3fe04c3611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.211323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-17331297-f1c4-4f01-9550-9b3fe04c3611 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:56.214328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-17331297-f1c4-4f01-9550-9b3fe04c3611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:56.240117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1038/2078] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:56.241484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17331297-f1c4-4f01-9550-9b3fe04c3611 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:56.261958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17331297-f1c4-4f01-9550-9b3fe04c3611 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:56.268199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:56.269027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.269436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.269829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.270731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:56.271125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:56.273020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:56.275094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd50b-557e-444c-aff2-92bcc2a18e5f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:56.286362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:56.287820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.287820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.287820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.293289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1039/2079] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:56.295150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:56.313181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b561814-0b80-4a81-8463-8ae42a3ae7c1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:56.313503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:56.316805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:56.333929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:56.334078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1041/2080] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:56.335504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.336653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.337019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.337797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:56.340886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:56.524085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1040/2081] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:56 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:56.530553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:56.553756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096e6b5-7685-4ee4-8263-d6bf702a8618 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:56.555387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:56.557854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:56.671405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:56.673731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.674027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.674312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.675035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:56.681480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:56.686581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9e159-f054-49d2-97c4-6c7609d20458 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:56.702555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:56.703520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.703813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.704287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] PATH_INFO: `/v3/projects/7fbd1fa117d148659b743c9c3bd4f65e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.705624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbd1fa117d148659b743c9c3bd4f65e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:56.707749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:56.877804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1042/2082] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:56 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:56.878636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:56.880498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:56.893127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89061b-2de6-4d7d-8125-58e63c492f6f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:56.898448 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:56.899369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:56.899653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:56.899936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] PATH_INFO: `/v3/users/696093856c864253a460e4b9362ce7cc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:56.901304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696093856c864253a460e4b9362ce7cc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:56.903493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:56.934671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbd1fa117d148659b743c9c3bd4f65e', 'request_id': 'req-0d64e3f3-5d6e-4908-b198-fe6613617bdc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.064360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbd1fa117d148659b743c9c3bd4f65e', 'request_id': 'req-0d64e3f3-5d6e-4908-b198-fe6613617bdc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.071649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbd1fa117d148659b743c9c3bd4f65e', 'request_id': 'req-0d64e3f3-5d6e-4908-b198-fe6613617bdc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.098129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] The token cache is being invalidate because project 7fbd1fa117d148659b743c9c3bd4f65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:57.098613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.099567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.101659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1041/2083] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:56 2022] DELETE /identity/v3/projects/7fbd1fa117d148659b743c9c3bd4f65e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:57.102939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:57.106201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:57.163972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696093856c864253a460e4b9362ce7cc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.171262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696093856c864253a460e4b9362ce7cc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.200267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696093856c864253a460e4b9362ce7cc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.211633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696093856c864253a460e4b9362ce7cc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.212411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696093856c864253a460e4b9362ce7cc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.221334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64e3f3-5d6e-4908-b198-fe6613617bdc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:57.227663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:57.228552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:57.229425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:57.229734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:57.230515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:57.232333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:57.253312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1042/2084] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:57.256561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:57.261906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:57.289853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05728f-ea88-428c-9922-88126d126b5e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:57.301073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:57.304354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:57.304880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:57.305443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] PATH_INFO: `/v3/users/564aa4dcdf7e44288afa721889450fe9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:57.308094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=564aa4dcdf7e44288afa721889450fe9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:57.312168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:57.360384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1043/2085] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:56 2022] DELETE /identity/v3/users/696093856c864253a460e4b9362ce7cc => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:57.363460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:57.369795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:57.386563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:57.488738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ae5a-409f-4a2f-994e-e5704b832771 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:57.496559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:57.497953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:57.503560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:57.503560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] PATH_INFO: `/v3/projects/46315203851a47a2a52967da055ffe65` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:57.503560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46315203851a47a2a52967da055ffe65)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:57.504005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:57.550789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564aa4dcdf7e44288afa721889450fe9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.551885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564aa4dcdf7e44288afa721889450fe9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.581226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:57.583275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564aa4dcdf7e44288afa721889450fe9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.599731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564aa4dcdf7e44288afa721889450fe9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.600803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564aa4dcdf7e44288afa721889450fe9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.652022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46315203851a47a2a52967da055ffe65', 'request_id': 'req-d2f967a3-5d56-4a45-8f60-718106f5f659'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.659983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46315203851a47a2a52967da055ffe65', 'request_id': 'req-d2f967a3-5d56-4a45-8f60-718106f5f659'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.670907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46315203851a47a2a52967da055ffe65', 'request_id': 'req-d2f967a3-5d56-4a45-8f60-718106f5f659'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.710782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1043/2086] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:57 2022] DELETE /identity/v3/users/564aa4dcdf7e44288afa721889450fe9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:57.711697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:57.713805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:57.784303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] The token cache is being invalidate because project 46315203851a47a2a52967da055ffe65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:57.784605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.785340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:57.787402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1044/2087] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:57 2022] DELETE /identity/v3/projects/46315203851a47a2a52967da055ffe65 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:57.791069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:57.793562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:57.852245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1a793-15b0-4e91-b116-e557a94484ff admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:57.875547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:57.877299 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:57.877548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:57.878952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:57.880438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:57.883398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:57.903975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1044/2088] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:57.905187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:57.912045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:57.931848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a435ed3-eec1-4830-a6d5-fd7812ce155d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:57.937088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:57.938514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:57.938737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:57.939122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] PATH_INFO: `/v3/projects/45145b9ccbe447b4964a521eb379c381` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:57.940431 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=45145b9ccbe447b4964a521eb379c381)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:57.940971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f967a3-5d56-4a45-8f60-718106f5f659 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:57.942837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:57.958000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:57.959548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:57.960025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:57.960455 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] PATH_INFO: `/v3/users/6f8279d07076413e9b85d0740c3aa39d` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:57.964020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8279d07076413e9b85d0740c3aa39d)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:57.966506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:58.119207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45145b9ccbe447b4964a521eb379c381', 'request_id': 'req-edb979ab-f503-4eb9-aadf-64fc269e67ba'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.242692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45145b9ccbe447b4964a521eb379c381', 'request_id': 'req-edb979ab-f503-4eb9-aadf-64fc269e67ba'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.249968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45145b9ccbe447b4964a521eb379c381', 'request_id': 'req-edb979ab-f503-4eb9-aadf-64fc269e67ba'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.263183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8279d07076413e9b85d0740c3aa39d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.263183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8279d07076413e9b85d0740c3aa39d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.279425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8279d07076413e9b85d0740c3aa39d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.289048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] The token cache is being invalidate because project 45145b9ccbe447b4964a521eb379c381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:58.289366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.290223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.291540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8279d07076413e9b85d0740c3aa39d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.292741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-722132c6-3db9-4336-8616-41178b3e9d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8279d07076413e9b85d0740c3aa39d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.292881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1045/2089] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:57 2022] DELETE /identity/v3/projects/45145b9ccbe447b4964a521eb379c381 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:58.294108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:58.295505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:58.373783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb979ab-f503-4eb9-aadf-64fc269e67ba admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:58.379108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea76c-1a15-4c73-8242-42b6d4b2d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:58.380224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea76c-1a15-4c73-8242-42b6d4b2d64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:58.380578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea76c-1a15-4c73-8242-42b6d4b2d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:58.380923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea76c-1a15-4c73-8242-42b6d4b2d64d admin admin] PATH_INFO: `/v3/projects/821c9ba3c1154765b2342e8410a25d31/users/735e4febdfb14a90b1eeb7628afd6d43/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:58.407130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1045/2090] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:47:57 2022] DELETE /identity/v3/users/6f8279d07076413e9b85d0740c3aa39d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:58.412127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:58.412549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:58.413107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:58.419712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea76c-1a15-4c73-8242-42b6d4b2d64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=821c9ba3c1154765b2342e8410a25d31, user_id=735e4febdfb14a90b1eeb7628afd6d43, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:58.422891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea76c-1a15-4c73-8242-42b6d4b2d64d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:58.441898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:58.443247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:58.513620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1046/2091] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:58.524787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:58.527403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:58.541446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1046/2092] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:58 2022] PUT /identity/v3/projects/821c9ba3c1154765b2342e8410a25d31/users/735e4febdfb14a90b1eeb7628afd6d43/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:58.544662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11009e-c466-45a9-bad7-00f92102f2ee None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:58.544792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cf10b-0e74-4d08-8c70-cbf0dbfea0d3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:58.544792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cf10b-0e74-4d08-8c70-cbf0dbfea0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:58.544792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cf10b-0e74-4d08-8c70-cbf0dbfea0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:58.575224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fd6cf10b-0e74-4d08-8c70-cbf0dbfea0d3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:58.576737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fd6cf10b-0e74-4d08-8c70-cbf0dbfea0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:58.609412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:58.610328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:58.610612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:58.610892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] PATH_INFO: `/v3/projects/b847a5700d4846ab9c0c9c472f93f630` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:58.612127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b847a5700d4846ab9c0c9c472f93f630)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:58.614112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:58.642820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1047/2093] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:58.644262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b000c-c42d-4baa-81ac-912b873c31f2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:58.644561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b000c-c42d-4baa-81ac-912b873c31f2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:58.644840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b000c-c42d-4baa-81ac-912b873c31f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:58.691242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4d8b000c-c42d-4baa-81ac-912b873c31f2 None None] MFA Rules not processed for user `735e4febdfb14a90b1eeb7628afd6d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:58.691242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4d8b000c-c42d-4baa-81ac-912b873c31f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:58.770498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b847a5700d4846ab9c0c9c472f93f630', 'request_id': 'req-d35698b9-ee98-4e86-ba06-3bfb21515299'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.778010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b847a5700d4846ab9c0c9c472f93f630', 'request_id': 'req-d35698b9-ee98-4e86-ba06-3bfb21515299'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.781362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1048/2094] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:58.782304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b000c-c42d-4baa-81ac-912b873c31f2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:58.789606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b847a5700d4846ab9c0c9c472f93f630', 'request_id': 'req-d35698b9-ee98-4e86-ba06-3bfb21515299'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.811385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b000c-c42d-4baa-81ac-912b873c31f2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:58.895286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:58.896042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:58.896566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:58.896920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:58.897810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:58.898126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:58.899829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:58.915933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1049/2095] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:58.916975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:58.918941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:58.954540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] The token cache is being invalidate because project b847a5700d4846ab9c0c9c472f93f630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:47:58.954540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.954540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:58.954540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1047/2096] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:58 2022] DELETE /identity/v3/projects/b847a5700d4846ab9c0c9c472f93f630 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:47:58.954540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:58.954929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:58.969553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35698b9-ee98-4e86-ba06-3bfb21515299 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:58.975578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ff380-da4c-4214-bf7e-2e9c6a7a8a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:58.976249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ff380-da4c-4214-bf7e-2e9c6a7a8a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:58.976540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ff380-da4c-4214-bf7e-2e9c6a7a8a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:58.977465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ff380-da4c-4214-bf7e-2e9c6a7a8a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:58.977579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ff380-da4c-4214-bf7e-2e9c6a7a8a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:58.979781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ff380-da4c-4214-bf7e-2e9c6a7a8a74 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:58.995400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e826-c608-4703-9796-9b39dced6ed3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:58.999324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:58.999985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.000272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.000565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.002404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:59.010461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:59.080123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1048/2097] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:58 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:59.081321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f862-fa0b-4bed-b3d6-3ad5cf72626a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.081662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f862-fa0b-4bed-b3d6-3ad5cf72626a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.081930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f862-fa0b-4bed-b3d6-3ad5cf72626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.086362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.086816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.102194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1050/2098] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:47:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:47:59.107996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-3632f862-fa0b-4bed-b3d6-3ad5cf72626a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:59.114580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3632f862-fa0b-4bed-b3d6-3ad5cf72626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:59.114755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.132937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129d959-31cd-4cac-8a72-7f00e83ec23d service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.149851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:59.218875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1049/2099] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:47:59.221776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4955d6-2db3-4461-af52-67b65e5251e7 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.222106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4955d6-2db3-4461-af52-67b65e5251e7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.222744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4955d6-2db3-4461-af52-67b65e5251e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.266804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-5c4955d6-2db3-4461-af52-67b65e5251e7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:59.268832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5c4955d6-2db3-4461-af52-67b65e5251e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:59.271311 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.273020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.273539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.274035 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.275074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.277449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.289732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1050/2100] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:47:59.297806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4955d6-2db3-4461-af52-67b65e5251e7 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.306073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4955d6-2db3-4461-af52-67b65e5251e7 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.312329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.313048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.313310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.313592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.314404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:47:59.314745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.316417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.333865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1051/2101] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:47:59.341610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.357632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6caa22-55b7-44c8-9569-dc8467b71524 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.369329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.370707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.372007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.372548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.374080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.378112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.420868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1051/2102] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:59 2022] POST /identity/v3/users => generated 282 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:59.425234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.438153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ac60-07d3-4d10-995a-991f73343df3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.444496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.445346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.445867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.446214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.452749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.452749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.470570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1052/2103] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:47:59.472125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.484527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc780929-b399-4474-a079-db8c6a550eb0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.492637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.495307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.495685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.496065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.497205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.499238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.512942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1053/2104] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:47:59.517466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.528748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eab97-6737-4bf5-96a2-5cbb57a3dbe6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.533975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.535793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.535793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.536940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] PATH_INFO: `/v3/projects/5b18114c803f48f8afa3c5a0e4cf10f4/users/2b1181fed72446ceb484d48747fe0e2c/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.556003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b18114c803f48f8afa3c5a0e4cf10f4, user_id=2b1181fed72446ceb484d48747fe0e2c, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.560234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.603357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1052/2105] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:47:59 2022] POST /identity/v3/projects => generated 365 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:59.606439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.610869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:59.684833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1054/2106] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:47:59 2022] PUT /identity/v3/projects/5b18114c803f48f8afa3c5a0e4cf10f4/users/2b1181fed72446ceb484d48747fe0e2c/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:47:59.685732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:47:59.693485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36566909-8a8f-4f0c-ae14-a9090567572b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.781881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229333b-2c1c-4f8b-93fc-3f2233f6aff0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:47:59.787209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9c49-a00e-4472-87a1-c8c97ef0293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.787943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9c49-a00e-4472-87a1-c8c97ef0293a admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.788234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9c49-a00e-4472-87a1-c8c97ef0293a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.788510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9c49-a00e-4472-87a1-c8c97ef0293a admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.789248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9c49-a00e-4472-87a1-c8c97ef0293a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.789404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:47:59.790308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.790603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.790874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] PATH_INFO: `/v3/projects/9aeee6d2ee6b4eff9ddc71a8ba490a4c` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.791294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9c49-a00e-4472-87a1-c8c97ef0293a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.792301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aeee6d2ee6b4eff9ddc71a8ba490a4c)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:47:59.794407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:47:59.895582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1055/2107] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:47:59 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:47:59.898331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e6a0c-07a5-4ff6-bf25-7e74f3238436 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:47:59.898331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e6a0c-07a5-4ff6-bf25-7e74f3238436 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:47:59.898729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e6a0c-07a5-4ff6-bf25-7e74f3238436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:47:59.927684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-664e6a0c-07a5-4ff6-bf25-7e74f3238436 None None] MFA Rules not processed for user `2b1181fed72446ceb484d48747fe0e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:47:59.929006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-664e6a0c-07a5-4ff6-bf25-7e74f3238436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:47:59.962936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aeee6d2ee6b4eff9ddc71a8ba490a4c', 'request_id': 'req-a55b37fa-7525-42dd-a39c-3254e8bcae56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:59.969309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aeee6d2ee6b4eff9ddc71a8ba490a4c', 'request_id': 'req-a55b37fa-7525-42dd-a39c-3254e8bcae56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:47:59.982153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aeee6d2ee6b4eff9ddc71a8ba490a4c', 'request_id': 'req-a55b37fa-7525-42dd-a39c-3254e8bcae56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:00.015218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1056/2108] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:00.015990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e6a0c-07a5-4ff6-bf25-7e74f3238436 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.032071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e6a0c-07a5-4ff6-bf25-7e74f3238436 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.077142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] The token cache is being invalidate because project 9aeee6d2ee6b4eff9ddc71a8ba490a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:00.077483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:00.078346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:00.080806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1053/2109] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:47:59 2022] DELETE /identity/v3/projects/9aeee6d2ee6b4eff9ddc71a8ba490a4c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:00.081607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.083520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:00.117434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4e3c5-efe1-4322-9826-e7ea7711e090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.118221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e3c5-efe1-4322-9826-e7ea7711e090 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.118425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e3c5-efe1-4322-9826-e7ea7711e090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.118708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e3c5-efe1-4322-9826-e7ea7711e090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.120066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4e3c5-efe1-4322-9826-e7ea7711e090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.121744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4e3c5-efe1-4322-9826-e7ea7711e090 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.139347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1057/2110] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:00.139347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.139347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.139347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.160864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:00.161669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:00.171741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b37fa-7525-42dd-a39c-3254e8bcae56 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.175759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1058/2111] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:00.182675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.184295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:00.186056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.187377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.187966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.188368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.189236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.191863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.197338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d798d0-d562-4ed4-9952-7c11e0426958 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.203897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e19c-c2fe-4b8b-825a-73bd968e4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.204559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e19c-c2fe-4b8b-825a-73bd968e4304 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.204845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e19c-c2fe-4b8b-825a-73bd968e4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.205595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e19c-c2fe-4b8b-825a-73bd968e4304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.206379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e19c-c2fe-4b8b-825a-73bd968e4304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.208193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e19c-c2fe-4b8b-825a-73bd968e4304 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.219593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1059/2112] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:00.220772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90572d57-a4a4-4cac-97d3-e30fdeb2d65c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.221062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90572d57-a4a4-4cac-97d3-e30fdeb2d65c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.221335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90572d57-a4a4-4cac-97d3-e30fdeb2d65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.240992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-90572d57-a4a4-4cac-97d3-e30fdeb2d65c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:00.243049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:00.243967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-90572d57-a4a4-4cac-97d3-e30fdeb2d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:00.253396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1060/2113] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:00.254268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90572d57-a4a4-4cac-97d3-e30fdeb2d65c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.265230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90572d57-a4a4-4cac-97d3-e30fdeb2d65c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.271156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.272066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.272345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.272617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] PATH_INFO: `/v3/projects/07ccc47f691d4ceb9c46cf37664e8334/users/449151b664c640ec9fec33925c6c2e56/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.289458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ccc47f691d4ceb9c46cf37664e8334, user_id=449151b664c640ec9fec33925c6c2e56, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.292280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.313334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:00.315696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1054/2114] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:00.316591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.371930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1061/2115] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:00 2022] PUT /identity/v3/projects/07ccc47f691d4ceb9c46cf37664e8334/users/449151b664c640ec9fec33925c6c2e56/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:00.373123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.392165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cb01b-ff5a-4ac6-a7d5-d315a5c0fadd admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.455118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9e0f-fdc4-4ed5-8505-801392c55fee admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.467851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.467851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.467851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.467851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.468615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.468615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.474298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3513-e8db-4ef4-b9b7-0b1e931a9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.475311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3513-e8db-4ef4-b9b7-0b1e931a9a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.478280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3513-e8db-4ef4-b9b7-0b1e931a9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.478280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3513-e8db-4ef4-b9b7-0b1e931a9a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.478280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3513-e8db-4ef4-b9b7-0b1e931a9a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:00.479511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3513-e8db-4ef4-b9b7-0b1e931a9a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.482527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3513-e8db-4ef4-b9b7-0b1e931a9a11 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.506912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1055/2116] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:00.510585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d55a4-e52f-4b4a-a46e-8a68905b0409 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.510585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d55a4-e52f-4b4a-a46e-8a68905b0409 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.511627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d55a4-e52f-4b4a-a46e-8a68905b0409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.562607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-176d55a4-e52f-4b4a-a46e-8a68905b0409 None None] MFA Rules not processed for user `449151b664c640ec9fec33925c6c2e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:00.564029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-176d55a4-e52f-4b4a-a46e-8a68905b0409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:00.578445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1062/2117] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:00.579737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.592327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d33e10-c12c-40da-9d6d-f95681f53a32 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.598256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.598935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.601377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.601935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.602695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.605449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.655772 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1056/2118] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:00.656900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d55a4-e52f-4b4a-a46e-8a68905b0409 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.669792 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d55a4-e52f-4b4a-a46e-8a68905b0409 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.676086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.676785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.677072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.677430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.678134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.679899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.697755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1057/2119] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:00.697755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.706726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1063/2120] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:00.708448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.716958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585509-4049-4107-9c99-33bba69278a0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.804971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.805833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.806201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.806555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.807649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.811031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a61ac-9c86-4931-95b6-354711191d8a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:00.811577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.832595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:00.833657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:00.834119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:00.834471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] PATH_INFO: `/v3/projects/0aa06971750d4efb9e7b78e54ffab09a/users/33cdebbcdbd44ccd8b038c36d61ab169/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:00.853768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa06971750d4efb9e7b78e54ffab09a, user_id=33cdebbcdbd44ccd8b038c36d61ab169, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:00.857460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:00.952541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1058/2121] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:00.953516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:00.986334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1064/2122] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:00 2022] PUT /identity/v3/projects/0aa06971750d4efb9e7b78e54ffab09a/users/33cdebbcdbd44ccd8b038c36d61ab169/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:00.990358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.028300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265fd5-33c6-4f86-8de5-7e185881d0aa admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.059939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20cee7-c4ca-4a34-9a5b-a62081454948 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.067194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.067780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.068878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.068878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.069168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.071060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.113463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.114377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.114827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.115108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.115837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.117881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.157863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:01.247175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1065/2123] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:01.247794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.257719 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81b31f-47ae-4a42-92b5-af5bbbe89569 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.263082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.263750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.264043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.264330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.265081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.266695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.278307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1066/2124] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:01.279178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.289226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea33125-c968-4595-91be-ccda59352fe4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.294792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.295514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.295789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.296068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.296906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.298573 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.310058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1067/2125] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:01.310912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.312540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:01.318143 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1059/2126] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:00 2022] POST /identity/v3/users => generated 292 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:01.319022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.324749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e6b93-ddb1-4d06-89ec-28bb32044b1f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.329942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.330841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.331127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.331402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] PATH_INFO: `/v3/projects/0aa06971750d4efb9e7b78e54ffab09a/users/33cdebbcdbd44ccd8b038c36d61ab169/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.332157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e770d3-545a-4a02-b500-c822321e1c06 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.333498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa06971750d4efb9e7b78e54ffab09a, user_id=33cdebbcdbd44ccd8b038c36d61ab169, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.336586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.337330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b40be-bd96-4700-a33f-1722b368f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.339292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b40be-bd96-4700-a33f-1722b368f52f admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.339596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b40be-bd96-4700-a33f-1722b368f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.339872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b40be-bd96-4700-a33f-1722b368f52f admin admin] PATH_INFO: `/v3/projects/3534d5b6beab4de1a322c9ffb007f2f5/users/59bc5e612f2d4e8db1bb112cf7754afe/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.348604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1068/2127] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:01 2022] PUT /identity/v3/projects/0aa06971750d4efb9e7b78e54ffab09a/users/33cdebbcdbd44ccd8b038c36d61ab169/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:01.349233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.359760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b40be-bd96-4700-a33f-1722b368f52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3534d5b6beab4de1a322c9ffb007f2f5, user_id=59bc5e612f2d4e8db1bb112cf7754afe, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.363871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b40be-bd96-4700-a33f-1722b368f52f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.426844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced95b7-03ad-40ce-be60-a4227d015065 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.431775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.432462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.432862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.433136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.433924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.435549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.448401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1060/2128] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:01 2022] PUT /identity/v3/projects/3534d5b6beab4de1a322c9ffb007f2f5/users/59bc5e612f2d4e8db1bb112cf7754afe/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:01.449737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fab159-0b33-4f7c-8572-487a310d3b9a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.451167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fab159-0b33-4f7c-8572-487a310d3b9a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.451167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fab159-0b33-4f7c-8572-487a310d3b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.456709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1069/2129] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:01.456709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.472025 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:01.477317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b787476-02c3-43d1-ac39-0420342421aa admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.488576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a2fab159-0b33-4f7c-8572-487a310d3b9a None None] MFA Rules not processed for user `33cdebbcdbd44ccd8b038c36d61ab169`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:01.489934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a2fab159-0b33-4f7c-8572-487a310d3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:01.555172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.556491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.557413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.557803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.559263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.562467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.569773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1061/2130] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:01.573427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fab159-0b33-4f7c-8572-487a310d3b9a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.583894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1070/2131] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:01.583894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.584918 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:01.585478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fab159-0b33-4f7c-8572-487a310d3b9a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.592604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.593291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.593606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.593926 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.594802 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.596572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.608846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1062/2132] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:01.609733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.620512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e924-833c-42b9-889a-7917cf1e2803 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.625439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.626357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.626642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.626914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] PATH_INFO: `/v3/projects/3534d5b6beab4de1a322c9ffb007f2f5/users/59bc5e612f2d4e8db1bb112cf7754afe/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.629141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3534d5b6beab4de1a322c9ffb007f2f5, user_id=59bc5e612f2d4e8db1bb112cf7754afe, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.632057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.643849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1063/2133] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:01 2022] PUT /identity/v3/projects/3534d5b6beab4de1a322c9ffb007f2f5/users/59bc5e612f2d4e8db1bb112cf7754afe/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:01.651545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:01.658325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a175e9-5cea-458b-bfe2-fc392ef79743 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.715946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ff1c-f42e-44d6-a786-a9f1b8b3a759 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:01.717251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4c0cc-f191-450b-b364-9257f33d97d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.717997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4c0cc-f191-450b-b364-9257f33d97d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.718200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4c0cc-f191-450b-b364-9257f33d97d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.718481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4c0cc-f191-450b-b364-9257f33d97d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.724597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9b258-190f-4192-bcc6-ca7fce44ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:01.725992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b258-190f-4192-bcc6-ca7fce44ec3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.726511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b258-190f-4192-bcc6-ca7fce44ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.727026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b258-190f-4192-bcc6-ca7fce44ec3b admin admin] PATH_INFO: `/v3/projects/1530272bb23e4bb4a14b09e4cf52a59b/users/d7994c12771b458aa9045d00f8fcf384/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.752759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:01.753013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9b258-190f-4192-bcc6-ca7fce44ec3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1530272bb23e4bb4a14b09e4cf52a59b, user_id=d7994c12771b458aa9045d00f8fcf384, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.755794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9b258-190f-4192-bcc6-ca7fce44ec3b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.792187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4c0cc-f191-450b-b364-9257f33d97d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:01.793792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4c0cc-f191-450b-b364-9257f33d97d5 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:01.803895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1071/2134] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:01.805198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2187c-bace-4608-9ce3-06f154affe21 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.805490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2187c-bace-4608-9ce3-06f154affe21 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.805797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2187c-bace-4608-9ce3-06f154affe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.832285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1064/2135] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:01 2022] PUT /identity/v3/projects/1530272bb23e4bb4a14b09e4cf52a59b/users/d7994c12771b458aa9045d00f8fcf384/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:01.837315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8ac2187c-bace-4608-9ce3-06f154affe21 None None] MFA Rules not processed for user `59bc5e612f2d4e8db1bb112cf7754afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:01.839174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ac2187c-bace-4608-9ce3-06f154affe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:01.849121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c930e-dd57-41b6-8fe3-fe51c9dc29ff None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:01.849658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c930e-dd57-41b6-8fe3-fe51c9dc29ff None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:01.849804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c930e-dd57-41b6-8fe3-fe51c9dc29ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:01.899405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:01.904317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-251c930e-dd57-41b6-8fe3-fe51c9dc29ff None None] MFA Rules not processed for user `d7994c12771b458aa9045d00f8fcf384`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:01.905906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-251c930e-dd57-41b6-8fe3-fe51c9dc29ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:01.941759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1072/2136] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:01.965664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2187c-bace-4608-9ce3-06f154affe21 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.007268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1065/2137] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:02.012949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c930e-dd57-41b6-8fe3-fe51c9dc29ff None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.045090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2187c-bace-4608-9ce3-06f154affe21 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.051728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.053032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.053363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.053897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.071853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.076228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.098583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1073/2138] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:02.106602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c930e-dd57-41b6-8fe3-fe51c9dc29ff None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.112866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.112866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.113149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.113380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.114171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.116130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.134446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.136859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:02.153285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7aaf-7c43-43ad-a6ac-1a713268efc0 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.157322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.158007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.158289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.158562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.160373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:02.217105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1066/2139] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:02 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:02.221372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.247295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.249056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.259417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1074/2140] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:02.302027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ff392-89e4-4683-ae01-dae0de6246b2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.309371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.310261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.310541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.310826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.311916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.314216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.339455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:02.408544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1067/2141] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:02 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:48:02.412868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.424677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f8a0-52f7-4a02-bdb7-505497c06b6e service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.429404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.430108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.430395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.430673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.431403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.433522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.443541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1075/2142] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:02.448337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.458983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114579-012b-40e9-b843-662320cb1968 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.465266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e1fe0-e2ff-4b0c-be09-899bca092589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.465994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1fe0-e2ff-4b0c-be09-899bca092589 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.466276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1fe0-e2ff-4b0c-be09-899bca092589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.466554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1fe0-e2ff-4b0c-be09-899bca092589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.467305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e1fe0-e2ff-4b0c-be09-899bca092589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.468971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e1fe0-e2ff-4b0c-be09-899bca092589 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.480211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1068/2143] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:02.486753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.507638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59af5-2f19-4aaf-a523-ec490345efbc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.512412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.513377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.513780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.514066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] PATH_INFO: `/v3/projects/8b2bab8fc750427d97fbba6e2da06af8/users/d41ba85800874705bb4919bfcc9799d6/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.536752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2bab8fc750427d97fbba6e2da06af8, user_id=d41ba85800874705bb4919bfcc9799d6, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.539666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.629492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1076/2144] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:02 2022] PUT /identity/v3/projects/8b2bab8fc750427d97fbba6e2da06af8/users/d41ba85800874705bb4919bfcc9799d6/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:02.647221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40e5c-6d25-4d7d-8dad-e72f6b449109 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.647512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40e5c-6d25-4d7d-8dad-e72f6b449109 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.647797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40e5c-6d25-4d7d-8dad-e72f6b449109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.655789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.657955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:02.732070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:02.736081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-27e40e5c-6d25-4d7d-8dad-e72f6b449109 None None] MFA Rules not processed for user `d41ba85800874705bb4919bfcc9799d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:02.737862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-27e40e5c-6d25-4d7d-8dad-e72f6b449109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:02.786365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ac67a-c9ce-41db-96da-fc1fb616cabb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.790725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:02.803610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.804543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.804846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.805114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] PATH_INFO: `/v3/users/735e4febdfb14a90b1eeb7628afd6d43` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.806487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735e4febdfb14a90b1eeb7628afd6d43)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.809092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.838167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1069/2145] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:02.847168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e40e5c-6d25-4d7d-8dad-e72f6b449109 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:02.864922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e40e5c-6d25-4d7d-8dad-e72f6b449109 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:02.875419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:02.875419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:02.875419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:02.875419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:02.876027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:02.876027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:02.987552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1070/2146] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:02 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:02.993905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.082746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8836991-a33b-499c-aa58-585ae89c8714 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:03.090643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:03.092271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.093313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.093856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.094897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:03.099039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:03.099407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735e4febdfb14a90b1eeb7628afd6d43'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.100211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735e4febdfb14a90b1eeb7628afd6d43'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.114549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735e4febdfb14a90b1eeb7628afd6d43'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.122038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:03.122763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735e4febdfb14a90b1eeb7628afd6d43'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.123510 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-785aaffb-ee3d-48f6-a6ef-7fae4f94cac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735e4febdfb14a90b1eeb7628afd6d43'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.259456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1071/2147] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:02 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:03.264021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.264799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:03.265930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.273611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1077/2148] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:02 2022] DELETE /identity/v3/users/735e4febdfb14a90b1eeb7628afd6d43 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:03.282217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397a62-6709-4cf9-b075-15ce2608e260 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.282925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397a62-6709-4cf9-b075-15ce2608e260 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.283439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397a62-6709-4cf9-b075-15ce2608e260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.286666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b1a8c-855b-4821-921c-9de310c047aa admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:03.323781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b1397a62-6709-4cf9-b075-15ce2608e260 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:03.325294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b1397a62-6709-4cf9-b075-15ce2608e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.363273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:03.363951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.364233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.364685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.366547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:03.374226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:03.383305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1072/2149] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:48:03.384138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.387042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.399562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1078/2150] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:03.401277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1397a62-6709-4cf9-b075-15ce2608e260 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.404780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6bb8-965b-4c96-84a3-16a970da5aac admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:03.410927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:03.412132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.412549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.413019 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] PATH_INFO: `/v3/users/449151b664c640ec9fec33925c6c2e56` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.414614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=449151b664c640ec9fec33925c6c2e56)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:03.419329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:03.421339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1397a62-6709-4cf9-b075-15ce2608e260 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:03.428058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:03.428625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.428864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.429155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] PATH_INFO: `/v3/projects/f1c3bbaa3d8545838c0d28ec0a47e4d0/users/ca984735bd104bdbb97c8a3b518de0b1/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.447947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c3bbaa3d8545838c0d28ec0a47e4d0, user_id=ca984735bd104bdbb97c8a3b518de0b1, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:03.453880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:03.573423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1079/2151] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:03 2022] PUT /identity/v3/projects/f1c3bbaa3d8545838c0d28ec0a47e4d0/users/ca984735bd104bdbb97c8a3b518de0b1/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:03.574455 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.576357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.637331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeda48-f666-4b56-b044-0e77d5fdb3c2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:03.641264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:03.645953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.645953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.645953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.707524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:03.707834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449151b664c640ec9fec33925c6c2e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.708955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449151b664c640ec9fec33925c6c2e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.716982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:03.718579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:03.723423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449151b664c640ec9fec33925c6c2e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.729550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1080/2152] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:03.730291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.733508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449151b664c640ec9fec33925c6c2e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.734386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e9536f-cecf-4b63-9d48-37c150e61206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449151b664c640ec9fec33925c6c2e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:03.741195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02d6f-40e1-4090-b08c-641ad5b77869 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:03.746620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:03.747307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.747656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.747852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.748637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:03.750304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:03.761061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1081/2153] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:03.765591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.768043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.787145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef1ac6-213c-4e5b-8916-e3215ab83edc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:03.795216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8b44a-84ca-4f4c-aab3-9fcb3e90f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:03.796602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b44a-84ca-4f4c-aab3-9fcb3e90f538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.796967 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b44a-84ca-4f4c-aab3-9fcb3e90f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.797318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b44a-84ca-4f4c-aab3-9fcb3e90f538 admin admin] PATH_INFO: `/v3/projects/f1c3bbaa3d8545838c0d28ec0a47e4d0/users/ca984735bd104bdbb97c8a3b518de0b1/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.800784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b44a-84ca-4f4c-aab3-9fcb3e90f538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c3bbaa3d8545838c0d28ec0a47e4d0, user_id=ca984735bd104bdbb97c8a3b518de0b1, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:03.805548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b44a-84ca-4f4c-aab3-9fcb3e90f538 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:03.818412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1082/2154] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:03 2022] PUT /identity/v3/projects/f1c3bbaa3d8545838c0d28ec0a47e4d0/users/ca984735bd104bdbb97c8a3b518de0b1/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:03.833708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.833864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.834057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.868121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] MFA Rules not processed for user `ca984735bd104bdbb97c8a3b518de0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:03.869589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.875899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1073/2155] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:03 2022] DELETE /identity/v3/users/449151b664c640ec9fec33925c6c2e56 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:03.884211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:03.884211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:03.884211 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:03.908702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:03.910213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.967978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1083/2156] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:03.990218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:03.993119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:03.993451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1074/2157] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:04.009415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:04.012053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:04.084341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b9d6-2422-43f8-ae18-d1f5bac60048 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:04.087227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc5d83-b49a-4ce0-af8e-aba8ad89be34 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:04.089410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:04.090118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:04.090401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:04.091630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:04.095063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:04.112047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:04.113518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:04.128940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1075/2158] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:04.165097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822542e-864f-41c7-8b11-1a83897fc615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:04.165670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822542e-864f-41c7-8b11-1a83897fc615 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:04.165988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822542e-864f-41c7-8b11-1a83897fc615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:04.166438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822542e-864f-41c7-8b11-1a83897fc615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:04.168403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6822542e-864f-41c7-8b11-1a83897fc615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:04.237027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822542e-864f-41c7-8b11-1a83897fc615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:04.238509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822542e-864f-41c7-8b11-1a83897fc615 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:04.249614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1084/2159] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:04.286412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:04.296311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:04.323454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743d8c-fcba-4001-898b-cca89b482b96 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:04.338440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:04.339475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:04.339762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:04.340043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] PATH_INFO: `/v3/projects/821c9ba3c1154765b2342e8410a25d31` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:04.341303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=821c9ba3c1154765b2342e8410a25d31)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:04.343278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:04.546605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821c9ba3c1154765b2342e8410a25d31', 'request_id': 'req-0521891f-b2f2-4f0d-b216-49f0ac47ca24'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:04.561761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821c9ba3c1154765b2342e8410a25d31', 'request_id': 'req-0521891f-b2f2-4f0d-b216-49f0ac47ca24'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:04.575646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821c9ba3c1154765b2342e8410a25d31', 'request_id': 'req-0521891f-b2f2-4f0d-b216-49f0ac47ca24'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:04.659548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:04.709638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] The token cache is being invalidate because project 821c9ba3c1154765b2342e8410a25d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:04.709977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:04.713824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0521891f-b2f2-4f0d-b216-49f0ac47ca24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:04.726427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1076/2160] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:04 2022] DELETE /identity/v3/projects/821c9ba3c1154765b2342e8410a25d31 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:04.741446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:04.741847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:04.742039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:04.796199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:04.798218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:04.890665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1085/2161] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:04.902898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:04.910260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ea3a5-a7ce-40d2-83a9-3b5b09884244 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:04.911201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ea3a5-a7ce-40d2-83a9-3b5b09884244 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:04.913980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ea3a5-a7ce-40d2-83a9-3b5b09884244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:04.926369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:04.928103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:04.956403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e88d-6f1e-460f-b9f6-139f5743b3a0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:04.957352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-252ea3a5-a7ce-40d2-83a9-3b5b09884244 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:04.959659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-252ea3a5-a7ce-40d2-83a9-3b5b09884244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:04.977631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:04.979543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:04.979847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:04.980248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] PATH_INFO: `/v3/projects/07ccc47f691d4ceb9c46cf37664e8334` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:04.982287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ccc47f691d4ceb9c46cf37664e8334)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:04.983680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1077/2162] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:04.985367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:04.987951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ea3a5-a7ce-40d2-83a9-3b5b09884244 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:04.999257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ea3a5-a7ce-40d2-83a9-3b5b09884244 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:05.004432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:05.005135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.005601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.006101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.006906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:05.007199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:05.008969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:05.023289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1078/2163] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:48:05.028109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:05.038521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe678a94-4f36-4b2c-88b3-803651025e47 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:05.044106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:05.044804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.045063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.045511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.046395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:05.048483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:05.144317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ccc47f691d4ceb9c46cf37664e8334', 'request_id': 'req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.204689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1079/2164] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:05 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:48:05.209030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:05.218738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ccc47f691d4ceb9c46cf37664e8334', 'request_id': 'req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.228662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ccc47f691d4ceb9c46cf37664e8334', 'request_id': 'req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.244098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] The token cache is being invalidate because project 07ccc47f691d4ceb9c46cf37664e8334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:05.244605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.247359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.249366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1086/2165] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:04 2022] DELETE /identity/v3/projects/07ccc47f691d4ceb9c46cf37664e8334 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:05.254643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:05.257327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:05.346235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb27f37-1188-4137-bb76-b0aa0e04fe84 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:05.352329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa2468-7b8d-4614-b3ca-0549e093bf7f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:05.352609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:05.360142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:05.361477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.362429 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.363226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.364491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:05.365363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:05.365534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.365785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.366048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] PATH_INFO: `/v3/users/59bc5e612f2d4e8db1bb112cf7754afe` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.367480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59bc5e612f2d4e8db1bb112cf7754afe)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:05.370024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:05.373427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:05.482969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1080/2166] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:05 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:48:05.489372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:05.492215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:05.507149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d2631-87b3-4ca2-9875-4d715435c752 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:05.512412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:05.513136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.513421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.513782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.514532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:05.516153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:05.530243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1081/2167] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:05.534287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:05.545292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369419-e318-4f04-b809-7f921a1829fb admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:05.550188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:05.550866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.551224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.551508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.552253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:05.553912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:05.565826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1082/2168] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:48:05.570138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:05.581313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c9e25-f027-4302-9b4d-9627f9a75db0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:05.586586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960a76b-914d-4197-89dd-82a1288478d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:05.587495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960a76b-914d-4197-89dd-82a1288478d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.587784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960a76b-914d-4197-89dd-82a1288478d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.589076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960a76b-914d-4197-89dd-82a1288478d6 admin admin] PATH_INFO: `/v3/projects/5fddabdc83704d359f6748853f476442/users/f01abef1d27142e9aac438f187b93ca9/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.602709 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:05.605865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960a76b-914d-4197-89dd-82a1288478d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fddabdc83704d359f6748853f476442, user_id=f01abef1d27142e9aac438f187b93ca9, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:05.610119 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960a76b-914d-4197-89dd-82a1288478d6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:05.622834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59bc5e612f2d4e8db1bb112cf7754afe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.623539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59bc5e612f2d4e8db1bb112cf7754afe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.636513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59bc5e612f2d4e8db1bb112cf7754afe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.643535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59bc5e612f2d4e8db1bb112cf7754afe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.644414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59bc5e612f2d4e8db1bb112cf7754afe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:05.711957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1083/2169] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:05 2022] PUT /identity/v3/projects/5fddabdc83704d359f6748853f476442/users/f01abef1d27142e9aac438f187b93ca9/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:05.719050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:05.719515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:05.719750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:05.738654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:05.740078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:05.805930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1087/2170] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:05 2022] DELETE /identity/v3/users/59bc5e612f2d4e8db1bb112cf7754afe => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:05.859842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1084/2171] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:05.881504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:05.884095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:05.953624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:06.025320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e3b57-11fc-44fe-9580-65136b61309e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:06.031532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f527f4-a05d-4f24-b2d7-517111e9c98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:06.032220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f527f4-a05d-4f24-b2d7-517111e9c98f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:06.032598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f527f4-a05d-4f24-b2d7-517111e9c98f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:06.033270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f527f4-a05d-4f24-b2d7-517111e9c98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:06.185751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f527f4-a05d-4f24-b2d7-517111e9c98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:06.189889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f527f4-a05d-4f24-b2d7-517111e9c98f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:06.215086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1088/2172] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:06.429914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:06.432198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:06.474788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6daf06-14a4-449d-91bd-a35866c99f56 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:06.481107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:06.482576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:06.482993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:06.483518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] PATH_INFO: `/v3/projects/3534d5b6beab4de1a322c9ffb007f2f5` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:06.486047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3534d5b6beab4de1a322c9ffb007f2f5)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:06.490973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:06.688156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3534d5b6beab4de1a322c9ffb007f2f5', 'request_id': 'req-ebfc5983-2926-4662-912c-a94a0f0040ba'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:06.694596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3534d5b6beab4de1a322c9ffb007f2f5', 'request_id': 'req-ebfc5983-2926-4662-912c-a94a0f0040ba'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:06.704704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3534d5b6beab4de1a322c9ffb007f2f5', 'request_id': 'req-ebfc5983-2926-4662-912c-a94a0f0040ba'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:06.842164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] The token cache is being invalidate because project 3534d5b6beab4de1a322c9ffb007f2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:06.842461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:06.843129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ebfc5983-2926-4662-912c-a94a0f0040ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:06.847202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1085/2173] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:06 2022] DELETE /identity/v3/projects/3534d5b6beab4de1a322c9ffb007f2f5 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:06.850236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc861b9-709a-47a7-a0d0-58ee1c095047 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:06.850736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc861b9-709a-47a7-a0d0-58ee1c095047 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:06.851586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc861b9-709a-47a7-a0d0-58ee1c095047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:06.874496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2fc861b9-709a-47a7-a0d0-58ee1c095047 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:06.876002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2fc861b9-709a-47a7-a0d0-58ee1c095047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:06.948957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1089/2174] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:06.952464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe034-a874-428e-95bf-79e5522d50a9 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:06.952712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe034-a874-428e-95bf-79e5522d50a9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:06.953412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe034-a874-428e-95bf-79e5522d50a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:06.976121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a80fe034-a874-428e-95bf-79e5522d50a9 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:06.978590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a80fe034-a874-428e-95bf-79e5522d50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:06.994632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1086/2175] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:07.003943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc861b9-709a-47a7-a0d0-58ee1c095047 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:07.022842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc861b9-709a-47a7-a0d0-58ee1c095047 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:07.029715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:07.030889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:07.031475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:07.031980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:07.033830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:07.034047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:07.037069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:07.057726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1090/2176] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:07.064975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe034-a874-428e-95bf-79e5522d50a9 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:07.085346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe034-a874-428e-95bf-79e5522d50a9 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:07.097849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:07.099180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:07.099797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:07.101123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:07.104326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:07.108496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:07.332137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1087/2177] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:07 2022] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:48:07.333547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:07.355139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af27739-da01-4a7f-8934-8434072e61f8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:07.427237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:07.488474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:07.489907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:07.490278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:07.490851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:07.492296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:07.499213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:07.625137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1091/2178] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:07 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:07.629140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:07.641182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9cd1-d499-42c2-9aa8-53e9f2a5b6f8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:07.647127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:07.647929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:07.648219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:07.648495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:07.649311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:07.652064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:07.672386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1088/2179] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:07.673962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:07.699335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af92e07-a61c-4de4-af07-a29607e12064 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:07.710409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:07.711098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:07.711381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:07.716557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:07.717400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:07.726221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:07.734802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1092/2180] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:07.739288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:07.754287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a1a92-d1d3-434e-ae89-f32e696b80cc admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:07.759541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4208a62-bd08-4d33-97fc-11195999aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:07.760498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4208a62-bd08-4d33-97fc-11195999aa71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:07.760831 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4208a62-bd08-4d33-97fc-11195999aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:07.761254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4208a62-bd08-4d33-97fc-11195999aa71 admin admin] PATH_INFO: `/v3/projects/f5951d53308b424ebb3d460234a0e1a8/users/7e05a195c7d142f3adc4af5829381f10/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:07.781823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4208a62-bd08-4d33-97fc-11195999aa71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5951d53308b424ebb3d460234a0e1a8, user_id=7e05a195c7d142f3adc4af5829381f10, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:07.784710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4208a62-bd08-4d33-97fc-11195999aa71 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:07.854240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:07.857014 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:07.938893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1089/2181] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:07 2022] PUT /identity/v3/projects/f5951d53308b424ebb3d460234a0e1a8/users/7e05a195c7d142f3adc4af5829381f10/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:07.941929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf60b0-a1f3-4dbf-885b-3caff88461a8 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:07.942275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf60b0-a1f3-4dbf-885b-3caff88461a8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:07.943020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf60b0-a1f3-4dbf-885b-3caff88461a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:07.980011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99af8-d31c-4b4e-8e4e-662588b29e7c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:08.008182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2bcf60b0-a1f3-4dbf-885b-3caff88461a8 None None] MFA Rules not processed for user `7e05a195c7d142f3adc4af5829381f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:08.009502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2bcf60b0-a1f3-4dbf-885b-3caff88461a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:08.075935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:08.076963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:08.077468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:08.078017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:08.080965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:08.143830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1090/2182] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:08.144844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf60b0-a1f3-4dbf-885b-3caff88461a8 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:08.168473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:08.172049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:08.198708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1093/2183] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:08.277601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf60b0-a1f3-4dbf-885b-3caff88461a8 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:08.285760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:08.286953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:08.287434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:08.288123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:08.289437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:08.294005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:08.435196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1091/2184] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:08 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:08.435903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:08.452157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6236-c7cc-40fe-aefa-3a96441bd72c service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:08.551647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:08.552413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:08.552969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:08.553330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:08.554384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:08.558410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:08.591508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:08.703778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1094/2185] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:08 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:48:08.704444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:08.723163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8bbce-a3c4-4a79-b56f-5c72226d8745 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:08.737620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:08.738670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:08.739398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:08.740353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:08.742885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:08.747248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:08.769821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1092/2186] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:08.774794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:08.794287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91e274-df89-4e84-8323-2694096e075a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:08.807932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:08.808900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:08.809189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:08.809471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] PATH_INFO: `/v3/projects/0d6822cce0aa41d09bd199d169931a77/users/6cce1e7d66fc40a6a1521bb40e80ea3a/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:08.836857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6822cce0aa41d09bd199d169931a77, user_id=6cce1e7d66fc40a6a1521bb40e80ea3a, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:08.845217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:08.937795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1095/2187] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:08 2022] PUT /identity/v3/projects/0d6822cce0aa41d09bd199d169931a77/users/6cce1e7d66fc40a6a1521bb40e80ea3a/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:08.938422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:08.950344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14d4d9-efa7-419c-9624-e88f108ba2c8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:09.031622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb8057-de8f-4dbc-acbb-c3a83d9c88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:09.032555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb8057-de8f-4dbc-acbb-c3a83d9c88d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:09.032859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb8057-de8f-4dbc-acbb-c3a83d9c88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:09.033390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb8057-de8f-4dbc-acbb-c3a83d9c88d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:09.034885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb8057-de8f-4dbc-acbb-c3a83d9c88d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:09.037494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb8057-de8f-4dbc-acbb-c3a83d9c88d4 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:09.061886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1093/2188] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:09.064955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:09.090675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd679-9990-417e-8dd4-5823eda68e89 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:09.114520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:09.116648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:09.117059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:09.117579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] PATH_INFO: `/v3/projects/0d6822cce0aa41d09bd199d169931a77/users/6cce1e7d66fc40a6a1521bb40e80ea3a/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:09.126259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6822cce0aa41d09bd199d169931a77, user_id=6cce1e7d66fc40a6a1521bb40e80ea3a, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:09.131245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:09.147139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1096/2189] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:09 2022] PUT /identity/v3/projects/0d6822cce0aa41d09bd199d169931a77/users/6cce1e7d66fc40a6a1521bb40e80ea3a/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:09.160344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056964cd-e7fd-498d-aa94-af645078e03a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:09.160718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056964cd-e7fd-498d-aa94-af645078e03a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:09.161125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056964cd-e7fd-498d-aa94-af645078e03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:09.216219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-056964cd-e7fd-498d-aa94-af645078e03a None None] MFA Rules not processed for user `6cce1e7d66fc40a6a1521bb40e80ea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:09.217721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-056964cd-e7fd-498d-aa94-af645078e03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:09.340707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1094/2190] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:09.358175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:09.360853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:09.450017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0ee4-a0cb-4d11-b9f6-61dff85a2c5f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:09.454620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:09.455512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:09.455678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:09.456057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:09.470906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:09.473453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:09.488495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1097/2191] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:10.477987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056964cd-e7fd-498d-aa94-af645078e03a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:10.493871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056964cd-e7fd-498d-aa94-af645078e03a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:10.507289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:10.507977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:10.508262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:10.508745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:10.513573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:10.624241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:10.656372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:10.659275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:10.681778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1095/2192] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:11.610269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:11.627715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22f58-0e56-4d84-be35-78930241611e service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:11.642998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce1e7d66fc40a6a1521bb40e80ea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6822cce0aa41d09bd199d169931a77', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:11.643724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:11.649445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:11.650027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:11.652031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:11.652252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:11.654638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:11.677876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1098/2193] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:11.679590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:11.701526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4995-2244-4bbd-b7f1-cba1dd95e63d service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:11.709759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce1e7d66fc40a6a1521bb40e80ea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6822cce0aa41d09bd199d169931a77', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:11.710757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:11.711315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:11.711759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:11.712810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:11.717337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:11.893007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1096/2194] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:11 2022] POST /identity/v3/projects => generated 353 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:11.899685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:11.903740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:11.918187 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345bee9-6cd5-4855-9a35-e74c3f5f1b53 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:12.033969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce1e7d66fc40a6a1521bb40e80ea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6822cce0aa41d09bd199d169931a77', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:12.034689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:12.034947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:12.035226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:12.035969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:12.036278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:12.038162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:12.052549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1099/2195] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:12.111172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:12.124140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7c69-a007-4ef2-9c24-937aa9ce934b tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:12.133152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce1e7d66fc40a6a1521bb40e80ea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6822cce0aa41d09bd199d169931a77', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:12.135432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:12.135983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:12.136924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] PATH_INFO: `/v3/projects/17fcd05ec7374da7b3dd5be534ef36c6` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:12.144581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17fcd05ec7374da7b3dd5be534ef36c6)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:12.144581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:12.305491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fcd05ec7374da7b3dd5be534ef36c6', 'request_id': 'req-8684e993-0061-44f4-995b-34ff6a3d8df5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:12.325446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fcd05ec7374da7b3dd5be534ef36c6', 'request_id': 'req-8684e993-0061-44f4-995b-34ff6a3d8df5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:12.340315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fcd05ec7374da7b3dd5be534ef36c6', 'request_id': 'req-8684e993-0061-44f4-995b-34ff6a3d8df5'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:12.486666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] The token cache is being invalidate because project 17fcd05ec7374da7b3dd5be534ef36c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:12.488039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:12.492686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:12.497730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1097/2196] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:12 2022] DELETE /identity/v3/projects/17fcd05ec7374da7b3dd5be534ef36c6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:13.625593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:13.627547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:13.707659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29434d5a-fa73-4c25-948a-9f41341b83a8 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:13.810851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:13.810851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:13.872211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:13.875023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:13.875856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:13.876595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] PATH_INFO: `/v3/users/2b1181fed72446ceb484d48747fe0e2c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:13.879723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1181fed72446ceb484d48747fe0e2c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:13.886908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:13.929630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684e993-0061-44f4-995b-34ff6a3d8df5 tempest-VolumeQuotaClassesTest-1918829117 tempest-VolumeQuotaClassesTest-1918829117-project-admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:13.937047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:13.938173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:13.938611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:13.939076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] PATH_INFO: `/v3/users/7e05a195c7d142f3adc4af5829381f10` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:13.940431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e05a195c7d142f3adc4af5829381f10)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:13.942481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:14.192002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:14.214489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e05a195c7d142f3adc4af5829381f10'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.215229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1181fed72446ceb484d48747fe0e2c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.215952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e05a195c7d142f3adc4af5829381f10'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.216119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1181fed72446ceb484d48747fe0e2c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.231292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e05a195c7d142f3adc4af5829381f10'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.238894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e05a195c7d142f3adc4af5829381f10'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.239916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f94c2979-902c-4ec9-b776-6f7062ae46fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e05a195c7d142f3adc4af5829381f10'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.253937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1181fed72446ceb484d48747fe0e2c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.271365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1181fed72446ceb484d48747fe0e2c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.272796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-244e6ecd-46e7-4b20-be59-a613bf4bf95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1181fed72446ceb484d48747fe0e2c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:14.348470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1098/2197] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:13 2022] DELETE /identity/v3/users/7e05a195c7d142f3adc4af5829381f10 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:14.351670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:14.352220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:14.352500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:14.376028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:14.377517 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:14.379237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:14.464410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1100/2198] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:13 2022] DELETE /identity/v3/users/2b1181fed72446ceb484d48747fe0e2c => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:14.469986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25eee9-11e2-4fee-8dfd-cecd805beaf7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:14.470403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25eee9-11e2-4fee-8dfd-cecd805beaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:14.470792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25eee9-11e2-4fee-8dfd-cecd805beaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:14.470998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1099/2199] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:14.488940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:14.490731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:14.554328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7b25eee9-11e2-4fee-8dfd-cecd805beaf7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:14.556331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7b25eee9-11e2-4fee-8dfd-cecd805beaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:14.632294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc184324-38a2-436a-99a0-6fc16a6c453f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:14.685127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1101/2200] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:14.692064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25eee9-11e2-4fee-8dfd-cecd805beaf7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:14.711478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:14.713505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:14.714017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:14.714669 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:14.737598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:14.739494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:14.752032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1100/2201] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:14.815874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25eee9-11e2-4fee-8dfd-cecd805beaf7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:14.820551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:14.825308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:14.825308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:14.825308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:14.841883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:14.843807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:14.860997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1102/2202] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:15.770762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:15.776315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:15.845010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:15.845572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:15.897536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441cdff-36fd-4a14-aff7-e116cadbc9b2 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:15.905978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fbb87-29fd-4470-88d0-14cb7d7d8942 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:15.913365 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:15.914678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:15.915153 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:15.915438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] PATH_INFO: `/v3/projects/5b18114c803f48f8afa3c5a0e4cf10f4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:15.918301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b18114c803f48f8afa3c5a0e4cf10f4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:15.925853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:15.926003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:15.926278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:15.926808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:15.927282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] PATH_INFO: `/v3/projects/f5951d53308b424ebb3d460234a0e1a8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:15.931025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5951d53308b424ebb3d460234a0e1a8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:15.935715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:16.143418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b18114c803f48f8afa3c5a0e4cf10f4', 'request_id': 'req-22c8a28b-0933-46de-8344-18ccb43f5f65'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.209880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5951d53308b424ebb3d460234a0e1a8', 'request_id': 'req-8fa0256b-b743-4f3e-a366-621301a52c9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.216423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5951d53308b424ebb3d460234a0e1a8', 'request_id': 'req-8fa0256b-b743-4f3e-a366-621301a52c9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.218576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b18114c803f48f8afa3c5a0e4cf10f4', 'request_id': 'req-22c8a28b-0933-46de-8344-18ccb43f5f65'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.230485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b18114c803f48f8afa3c5a0e4cf10f4', 'request_id': 'req-22c8a28b-0933-46de-8344-18ccb43f5f65'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.256387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5951d53308b424ebb3d460234a0e1a8', 'request_id': 'req-8fa0256b-b743-4f3e-a366-621301a52c9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.265911 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] The token cache is being invalidate because project 5b18114c803f48f8afa3c5a0e4cf10f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:16.266426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.270154 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-22c8a28b-0933-46de-8344-18ccb43f5f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.273407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1103/2203] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:15 2022] DELETE /identity/v3/projects/5b18114c803f48f8afa3c5a0e4cf10f4 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:16.290863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:16.291400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:16.291757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:16.332582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] MFA Rules not processed for user `f01abef1d27142e9aac438f187b93ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:16.333906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:16.367138 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] The token cache is being invalidate because project f5951d53308b424ebb3d460234a0e1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:16.367443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.368955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.371103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1101/2204] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:15 2022] DELETE /identity/v3/projects/f5951d53308b424ebb3d460234a0e1a8 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:16.372160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:16.375783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:16.512071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1104/2205] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:16.513300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:16.515268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:16.523847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0256b-b743-4f3e-a366-621301a52c9c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:16.524503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:16.525482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:16.525837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:16.532695 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] PATH_INFO: `/v3/users/33cdebbcdbd44ccd8b038c36d61ab169` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:16.534205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cdebbcdbd44ccd8b038c36d61ab169)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:16.536671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:16.553093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6043d7c-8c4c-4e80-8e9c-09b8d6a0af1e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:16.563020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:16.564055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:16.564253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:16.564536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] PATH_INFO: `/v3/users/6cce1e7d66fc40a6a1521bb40e80ea3a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:16.566396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cce1e7d66fc40a6a1521bb40e80ea3a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:16.568753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:16.635698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:16.857756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cdebbcdbd44ccd8b038c36d61ab169'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.858883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cdebbcdbd44ccd8b038c36d61ab169'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.880932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cdebbcdbd44ccd8b038c36d61ab169'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.897020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cdebbcdbd44ccd8b038c36d61ab169'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.898148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cdebbcdbd44ccd8b038c36d61ab169'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.925894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cce1e7d66fc40a6a1521bb40e80ea3a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.926870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cce1e7d66fc40a6a1521bb40e80ea3a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.947252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cce1e7d66fc40a6a1521bb40e80ea3a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.956395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cce1e7d66fc40a6a1521bb40e80ea3a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.957115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cce1e7d66fc40a6a1521bb40e80ea3a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:16.977426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1102/2206] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:16 2022] DELETE /identity/v3/users/33cdebbcdbd44ccd8b038c36d61ab169 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:16.986915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:16.988378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:17.134518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937dd9e-14ec-4a3b-9ec1-b6efa9b272c2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:17.143368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:17.144597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:17.145490 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:17.146317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:17.147713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:17.149979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1105/2207] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:16 2022] DELETE /identity/v3/users/6cce1e7d66fc40a6a1521bb40e80ea3a => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:17.154951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:17.321344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1103/2208] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:16 2022] POST /identity/v3/projects => generated 371 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:17.327222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:17.329472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:17.423773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a3800-0a3b-4ff6-acde-8324bea24884 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:17.568163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:17.573741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:17.574742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:17.576126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:17.581955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:17.584341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:17.586348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:17.604985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:17.613943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79d5ad-44a6-485a-88bc-d7e7323c4241 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:17.622845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:17.623777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:17.624088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:17.624345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] PATH_INFO: `/v3/users/d7994c12771b458aa9045d00f8fcf384` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:17.626862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7994c12771b458aa9045d00f8fcf384)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:17.633785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:17.731314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1106/2209] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:17 2022] POST /identity/v3/users => generated 292 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:17.733475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:17.742165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:17.795395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012b57-14d6-468d-a5e8-468eab1413c4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:17.808796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:17.810171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:17.810930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:17.812295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] PATH_INFO: `/v3/projects/0aa06971750d4efb9e7b78e54ffab09a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:17.814485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa06971750d4efb9e7b78e54ffab09a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:17.816817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:17.875527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7994c12771b458aa9045d00f8fcf384'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:17.876358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7994c12771b458aa9045d00f8fcf384'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:17.891532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7994c12771b458aa9045d00f8fcf384'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:17.901068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7994c12771b458aa9045d00f8fcf384'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:17.902318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7994c12771b458aa9045d00f8fcf384'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:17.916935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:17.986008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa06971750d4efb9e7b78e54ffab09a', 'request_id': 'req-0bee429d-41aa-45f1-b025-36f2f99525ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.019723 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1104/2210] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:17 2022] DELETE /identity/v3/users/d7994c12771b458aa9045d00f8fcf384 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:18.023879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:18.026524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.116875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa06971750d4efb9e7b78e54ffab09a', 'request_id': 'req-0bee429d-41aa-45f1-b025-36f2f99525ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.126127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa06971750d4efb9e7b78e54ffab09a', 'request_id': 'req-0bee429d-41aa-45f1-b025-36f2f99525ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.147234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8753-9feb-44d6-a632-a8e8ab8650bd admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:18.153212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] The token cache is being invalidate because project 0aa06971750d4efb9e7b78e54ffab09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:18.153667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.155238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.157572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1107/2211] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:17 2022] DELETE /identity/v3/projects/0aa06971750d4efb9e7b78e54ffab09a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:18.160399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:18.163120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5629a-9af5-44ab-a691-2c427d61ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:18.163459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.164599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5629a-9af5-44ab-a691-2c427d61ffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.165236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5629a-9af5-44ab-a691-2c427d61ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.167083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5629a-9af5-44ab-a691-2c427d61ffd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.168124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5629a-9af5-44ab-a691-2c427d61ffd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:18.170452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5629a-9af5-44ab-a691-2c427d61ffd1 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:18.186830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1105/2212] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:18.189393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225e4f-3d6c-444a-b858-47eae80febde None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.190351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225e4f-3d6c-444a-b858-47eae80febde None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.190796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225e4f-3d6c-444a-b858-47eae80febde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.217946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-76225e4f-3d6c-444a-b858-47eae80febde None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:18.219563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-76225e4f-3d6c-444a-b858-47eae80febde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.236716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1106/2213] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:18.239244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.239832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.241287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.270164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:18.271805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.284713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1107/2214] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:18.290856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:18.295262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.298223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee429d-41aa-45f1-b025-36f2f99525ec admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:18.304474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06996956-cea4-4729-814f-d890944087cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:18.305506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996956-cea4-4729-814f-d890944087cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.306018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996956-cea4-4729-814f-d890944087cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.306535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996956-cea4-4729-814f-d890944087cb admin admin] PATH_INFO: `/v3/projects/0d6822cce0aa41d09bd199d169931a77` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.309339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440825b-1286-4d93-9e71-237f38b9ff26 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:18.313802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06996956-cea4-4729-814f-d890944087cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6822cce0aa41d09bd199d169931a77)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:18.317971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06996956-cea4-4729-814f-d890944087cb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:18.322729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:18.322729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.322729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.322729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] PATH_INFO: `/v3/projects/3753337a3d0949f5979afb9fbe4855e9/users/e06fd33c6951412e97117b865414a963/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.346078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3753337a3d0949f5979afb9fbe4855e9, user_id=e06fd33c6951412e97117b865414a963, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:18.349414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:18.512238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1108/2215] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:18 2022] PUT /identity/v3/projects/3753337a3d0949f5979afb9fbe4855e9/users/e06fd33c6951412e97117b865414a963/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:18.513226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:18.525195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.576427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06996956-cea4-4729-814f-d890944087cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6822cce0aa41d09bd199d169931a77', 'request_id': 'req-06996956-cea4-4729-814f-d890944087cb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.602401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58013e-9616-4a1e-b482-7043959dfa74 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:18.659310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:18.660112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.660395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.660675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.704290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06996956-cea4-4729-814f-d890944087cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6822cce0aa41d09bd199d169931a77', 'request_id': 'req-06996956-cea4-4729-814f-d890944087cb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.704290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06996956-cea4-4729-814f-d890944087cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6822cce0aa41d09bd199d169931a77', 'request_id': 'req-06996956-cea4-4729-814f-d890944087cb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.731701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06996956-cea4-4729-814f-d890944087cb admin admin] The token cache is being invalidate because project 0d6822cce0aa41d09bd199d169931a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:18.732008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06996956-cea4-4729-814f-d890944087cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.733551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06996956-cea4-4729-814f-d890944087cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:18.735933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1108/2216] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:18 2022] DELETE /identity/v3/projects/0d6822cce0aa41d09bd199d169931a77 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:18.740893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187f93-09fb-4e0f-8e89-7229e56e0443 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.741194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187f93-09fb-4e0f-8e89-7229e56e0443 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.741927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187f93-09fb-4e0f-8e89-7229e56e0443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.762174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:18.763916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:18.785500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-93187f93-09fb-4e0f-8e89-7229e56e0443 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:18.787469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-93187f93-09fb-4e0f-8e89-7229e56e0443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.789774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1109/2217] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:18.792664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:18.811728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1109/2218] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:18.813617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.813954 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.814243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.821440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3154a-5d77-4015-96c1-38fd73ba7962 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:18.832198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:18.833823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.834326 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.834775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.836075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:18.838427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:18.861446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:18.864379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.874891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1110/2219] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:18.876427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:18.891412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1110/2220] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:18.899778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:18.904463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:18.910353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcd44-2adf-4425-b15c-5d6e1c7a7f26 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:18.919268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa134fc-8cf8-41ea-b025-132018fc5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:18.920876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa134fc-8cf8-41ea-b025-132018fc5eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.921227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa134fc-8cf8-41ea-b025-132018fc5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.921620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa134fc-8cf8-41ea-b025-132018fc5eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.922665 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa134fc-8cf8-41ea-b025-132018fc5eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:18.922978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa134fc-8cf8-41ea-b025-132018fc5eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:18.925476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa134fc-8cf8-41ea-b025-132018fc5eb1 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:18.927981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e194d0-c0e4-410e-9068-3da8a2bcbd48 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:18.942052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd736479-1709-49d5-a08f-a3a0b9d37e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:18.943686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736479-1709-49d5-a08f-a3a0b9d37e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.944216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736479-1709-49d5-a08f-a3a0b9d37e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.944702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736479-1709-49d5-a08f-a3a0b9d37e75 admin admin] PATH_INFO: `/v3/projects/3753337a3d0949f5979afb9fbe4855e9/users/e06fd33c6951412e97117b865414a963/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.951063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1111/2221] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:18.952872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1b68-2b5f-42a1-8433-b3e52947d210 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:18.953257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1b68-2b5f-42a1-8433-b3e52947d210 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:18.953497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1b68-2b5f-42a1-8433-b3e52947d210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:18.955875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd736479-1709-49d5-a08f-a3a0b9d37e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3753337a3d0949f5979afb9fbe4855e9, user_id=e06fd33c6951412e97117b865414a963, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:18.967280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd736479-1709-49d5-a08f-a3a0b9d37e75 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:18.976808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-15ce1b68-2b5f-42a1-8433-b3e52947d210 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:18.978231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-15ce1b68-2b5f-42a1-8433-b3e52947d210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:19.016188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1111/2222] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:18 2022] PUT /identity/v3/projects/3753337a3d0949f5979afb9fbe4855e9/users/e06fd33c6951412e97117b865414a963/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:19.022841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20305-bbd6-4b02-99bf-11fbf634c615 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.023215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20305-bbd6-4b02-99bf-11fbf634c615 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.025061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20305-bbd6-4b02-99bf-11fbf634c615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.056194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ecd20305-bbd6-4b02-99bf-11fbf634c615 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:19.058486 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ecd20305-bbd6-4b02-99bf-11fbf634c615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:19.132707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1112/2223] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:19.134016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1b68-2b5f-42a1-8433-b3e52947d210 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.147960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1b68-2b5f-42a1-8433-b3e52947d210 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.154215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.155075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.155442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.155767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.156865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.160834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.171205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1112/2224] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:19.172238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20305-bbd6-4b02-99bf-11fbf634c615 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.195288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20305-bbd6-4b02-99bf-11fbf634c615 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.206685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.207451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.207758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.208037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.208777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:19.209088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.210876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.235706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1113/2225] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:19.238457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.255648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57242429-ec2c-4e7a-91c6-a043aefdc703 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.261571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.262924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.263287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.263905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.265298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.268135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.342055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1113/2226] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:19 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:19.343195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.345808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:19.371414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1114/2227] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:19 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:19.376163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.442098 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38325bdf-8ec8-4449-b2b9-ea2e0032bc2b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.476249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167975-0da6-4d29-a4ad-be496799bf34 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.482195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.485970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.485970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.485970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.485970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.486763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.544077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.544077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.544077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.545133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.602081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1115/2228] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:19 2022] POST /identity/v3/users => generated 282 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:19.602081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.611274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e1f9-b488-4ee1-9eea-8c9f39cd1f68 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.618276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.618978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.619801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.620082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.620805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.625440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.692392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.694778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.717524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1114/2229] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:48:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:48:19.718084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.720461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:19.754068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1116/2230] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:19 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:19.754068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.772575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da3f7-23ab-4fc1-8eac-67be06d136e9 service swift] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.776040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.780270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a31e45-abde-40d0-8f56-f8c2f83fc666 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.786018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.794075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.794075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.794075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.794075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.794075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.795718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.796011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.796438 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] PATH_INFO: `/v3/projects/1530272bb23e4bb4a14b09e4cf52a59b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.798070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1530272bb23e4bb4a14b09e4cf52a59b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.800132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.806073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1117/2231] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:19.807159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.820499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b99b4-89fd-4330-8b84-eafad1b17f72 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.826765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.827854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.827854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.828290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.829117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.831017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.843616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1118/2232] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:19.844790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.857981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed92fe8-28e6-483a-874e-0d493e91115e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.865447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.866259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.866625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.867414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.868645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.870909 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.882989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1119/2233] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:19.883911 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.896095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364dfb6-3ef8-4074-a40f-7bab4a99e40e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.903566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:19.908974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:19.908974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:19.908974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:19.908974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:19.908974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:19.927384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1120/2234] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:19.933837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:19.939498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20875-b0d0-46e3-85d5-9e7881abf3fa admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:19.975064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1530272bb23e4bb4a14b09e4cf52a59b', 'request_id': 'req-4488397d-1211-4d00-bed6-124da9578933'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:19.982734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1530272bb23e4bb4a14b09e4cf52a59b', 'request_id': 'req-4488397d-1211-4d00-bed6-124da9578933'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.004417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1530272bb23e4bb4a14b09e4cf52a59b', 'request_id': 'req-4488397d-1211-4d00-bed6-124da9578933'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.026887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:20.027945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:20.028522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:20.028816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] PATH_INFO: `/v3/projects/1fcb498cab8c46999ec342932f7b7d82/users/715fec843ead4ec7becb0793a652b252/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:20.046445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcb498cab8c46999ec342932f7b7d82, user_id=715fec843ead4ec7becb0793a652b252, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:20.049364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:20.146008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] The token cache is being invalidate because project 1530272bb23e4bb4a14b09e4cf52a59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:20.146563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.147331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.148996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1115/2235] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:19 2022] DELETE /identity/v3/projects/1530272bb23e4bb4a14b09e4cf52a59b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:20.149885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:20.154299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.174174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488397d-1211-4d00-bed6-124da9578933 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:20.181625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fc30c-4f01-42b7-b759-b7eba781c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:20.183738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc30c-4f01-42b7-b759-b7eba781c04e admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:20.184226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc30c-4f01-42b7-b759-b7eba781c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:20.185351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc30c-4f01-42b7-b759-b7eba781c04e admin admin] PATH_INFO: `/v3/projects/1db518a7c0264906a196bbc05a84a08c/users/4f3a2ae8641842008bfd14218b1ac1e6/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:20.204147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1121/2236] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:19 2022] PUT /identity/v3/projects/1fcb498cab8c46999ec342932f7b7d82/users/715fec843ead4ec7becb0793a652b252/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:20.205186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:20.209637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.212217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fc30c-4f01-42b7-b759-b7eba781c04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db518a7c0264906a196bbc05a84a08c, user_id=4f3a2ae8641842008bfd14218b1ac1e6, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:20.218273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fc30c-4f01-42b7-b759-b7eba781c04e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:20.319004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1116/2237] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:20 2022] PUT /identity/v3/projects/1db518a7c0264906a196bbc05a84a08c/users/4f3a2ae8641842008bfd14218b1ac1e6/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:20.321297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee4a0-35ff-4008-aff7-25e94de6717e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:20.321891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee4a0-35ff-4008-aff7-25e94de6717e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:20.322947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee4a0-35ff-4008-aff7-25e94de6717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:20.368356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87a48-8024-40f7-bc0d-700571bf0a00 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:20.372008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-9cbee4a0-35ff-4008-aff7-25e94de6717e None None] MFA Rules not processed for user `715fec843ead4ec7becb0793a652b252`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:20.373433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9cbee4a0-35ff-4008-aff7-25e94de6717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.401421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:20.472004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:20.473108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:20.473645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:20.474303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] PATH_INFO: `/v3/users/d41ba85800874705bb4919bfcc9799d6` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:20.476787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41ba85800874705bb4919bfcc9799d6)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:20.480944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:20.503031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1117/2238] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:20.503031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:20.503031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:20.503031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:20.560696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:20.560696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.571088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1118/2239] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:20.571088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:20.571088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.578767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:20.593861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df388-4b82-4c8b-a25f-5ade2aa8f0e1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:20.599129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:20.599935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:20.600226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:20.600647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:20.601656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:20.603500 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:20.714293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1119/2240] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:20 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:20.715360 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:20.717545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.790135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41ba85800874705bb4919bfcc9799d6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.794303 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41ba85800874705bb4919bfcc9799d6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.803893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9eea-7123-4eac-8d8b-bd05e0709d85 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:20.810840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41ba85800874705bb4919bfcc9799d6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.811374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ad766-4cff-4721-9ce0-caa1fc16f28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:20.812546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ad766-4cff-4721-9ce0-caa1fc16f28c service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:20.813043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ad766-4cff-4721-9ce0-caa1fc16f28c service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:20.813494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ad766-4cff-4721-9ce0-caa1fc16f28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:20.815586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9f0ad766-4cff-4721-9ce0-caa1fc16f28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.823958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41ba85800874705bb4919bfcc9799d6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.825210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41ba85800874705bb4919bfcc9799d6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:20.906195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1122/2241] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:20 2022] DELETE /identity/v3/users/d41ba85800874705bb4919bfcc9799d6 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:20.909740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:20.911584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:20.965241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ad766-4cff-4721-9ce0-caa1fc16f28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:20.969218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ad766-4cff-4721-9ce0-caa1fc16f28c service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:20.998426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1120/2242] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:21.096862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dcd89-4b40-49ae-b233-cc544ece4894 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:21.112441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:21.113119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.113413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.113714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.114566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:21.116488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:21.123414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.123777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.124200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.144491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:21.145824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:21.226384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1121/2243] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:21.243421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:21.245612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:21.287571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1123/2244] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:20 2022] POST /identity/v3/users => generated 289 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:21.289541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:21.311492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c028-40ec-41d2-a2f6-08e611d338d7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:21.319511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:21.320476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.320761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.321064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.322650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:21.324698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:21.363144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c48dd7-7ef8-4036-b3b8-5edefe6ca961 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:21.370868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:21.371960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.372317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.372683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.373979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1124/2245] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:21.378820 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:21.390003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:21.405006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:21.405155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80458-5921-410a-92d2-a58725038d6b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:21.405155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:21.406018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.406407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.406630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] PATH_INFO: `/v3/projects/6a1ed5cfb9034b95ba5c4c8a97e45e68/users/1cd3b09a57c44171806621d366a68da8/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.426604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1ed5cfb9034b95ba5c4c8a97e45e68, user_id=1cd3b09a57c44171806621d366a68da8, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:21.426797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1122/2246] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:48:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:48:21.430591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:21.538359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1125/2247] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:21 2022] PUT /identity/v3/projects/6a1ed5cfb9034b95ba5c4c8a97e45e68/users/1cd3b09a57c44171806621d366a68da8/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:21.542554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:21.556357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbef78-8bfd-48d2-a8d0-aa99c004a544 service swift] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:21.640378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e46792-835f-4a54-b49c-6f17bf8e5b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:21.641187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46792-835f-4a54-b49c-6f17bf8e5b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.641503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46792-835f-4a54-b49c-6f17bf8e5b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.641855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46792-835f-4a54-b49c-6f17bf8e5b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.643319 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e46792-835f-4a54-b49c-6f17bf8e5b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:21.645243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e46792-835f-4a54-b49c-6f17bf8e5b2c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:21.665457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:21.672068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1123/2248] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:21.679472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baccab-761d-4aaf-81b5-f8cd0208d086 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:21.685118 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:21.686099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.687339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.687339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] PATH_INFO: `/v3/projects/6a1ed5cfb9034b95ba5c4c8a97e45e68/users/1cd3b09a57c44171806621d366a68da8/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.690770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1ed5cfb9034b95ba5c4c8a97e45e68, user_id=1cd3b09a57c44171806621d366a68da8, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:21.694181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:21.720418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1126/2249] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:21 2022] PUT /identity/v3/projects/6a1ed5cfb9034b95ba5c4c8a97e45e68/users/1cd3b09a57c44171806621d366a68da8/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:21.733947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.734249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.734538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.779778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] MFA Rules not processed for user `1cd3b09a57c44171806621d366a68da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:21.782798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:21.877627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1124/2250] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:21.898762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:21.904083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:21.974524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067531fc-c38b-42ee-ad71-b1a0989204f8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:21.979499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:21.980191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:21.980491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:21.980807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:21.991606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:21.993143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:22.005947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1127/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:22.219337 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:22.221176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:22.333808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:22.347539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f47d66-d355-4d39-a6da-3f035b4a52d8 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:22.360022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789471f5-36e6-4470-98b4-dfaa90e0b939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:22.360905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789471f5-36e6-4470-98b4-dfaa90e0b939 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:22.361386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789471f5-36e6-4470-98b4-dfaa90e0b939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:22.361862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789471f5-36e6-4470-98b4-dfaa90e0b939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:22.365847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-789471f5-36e6-4470-98b4-dfaa90e0b939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:22.441309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691534-db84-4408-9e7e-f4d6bdc8718e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:22.454537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:22.456113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:22.456814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:22.457423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] PATH_INFO: `/v3/projects/8b2bab8fc750427d97fbba6e2da06af8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:22.460003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2bab8fc750427d97fbba6e2da06af8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:22.466491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:22.487621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789471f5-36e6-4470-98b4-dfaa90e0b939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:22.492296 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789471f5-36e6-4470-98b4-dfaa90e0b939 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:22.523579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1128/2252] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:22.526792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ca51-f2ac-48d5-a53e-7e1e08dbaced None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:22.528386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ca51-f2ac-48d5-a53e-7e1e08dbaced None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:22.529008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ca51-f2ac-48d5-a53e-7e1e08dbaced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:22.568789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8e08ca51-f2ac-48d5-a53e-7e1e08dbaced None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:22.574298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8e08ca51-f2ac-48d5-a53e-7e1e08dbaced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:22.709294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1129/2253] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:48:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:22.717780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:22.728487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2bab8fc750427d97fbba6e2da06af8', 'request_id': 'req-5e31a955-dfb9-4347-a238-919be1c8b293'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:22.735180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08ca51-f2ac-48d5-a53e-7e1e08dbaced None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:22.737445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2bab8fc750427d97fbba6e2da06af8', 'request_id': 'req-5e31a955-dfb9-4347-a238-919be1c8b293'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:22.750381 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2bab8fc750427d97fbba6e2da06af8', 'request_id': 'req-5e31a955-dfb9-4347-a238-919be1c8b293'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:22.794104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:22.861966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] The token cache is being invalidate because project 8b2bab8fc750427d97fbba6e2da06af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:22.862280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:22.863899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:22.868679 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1125/2254] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:22 2022] DELETE /identity/v3/projects/8b2bab8fc750427d97fbba6e2da06af8 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:22.874029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:22.877759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:22.883479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08ca51-f2ac-48d5-a53e-7e1e08dbaced None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:23.012661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8ad23-e87e-4392-9f32-2698d7bfb1fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:23.013357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ad23-e87e-4392-9f32-2698d7bfb1fe service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:23.013862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ad23-e87e-4392-9f32-2698d7bfb1fe service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:23.014121 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ad23-e87e-4392-9f32-2698d7bfb1fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:23.018177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9bb8ad23-e87e-4392-9f32-2698d7bfb1fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:23.027487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31a955-dfb9-4347-a238-919be1c8b293 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:23.033827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:23.035148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:23.035430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:23.035765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] PATH_INFO: `/v3/users/ca984735bd104bdbb97c8a3b518de0b1` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:23.037221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca984735bd104bdbb97c8a3b518de0b1)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:23.039363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:23.094170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8ad23-e87e-4392-9f32-2698d7bfb1fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:23.095930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8ad23-e87e-4392-9f32-2698d7bfb1fe service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:23.106501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1130/2255] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:48:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 08:48:23.359079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca984735bd104bdbb97c8a3b518de0b1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:23.361571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca984735bd104bdbb97c8a3b518de0b1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:23.401061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca984735bd104bdbb97c8a3b518de0b1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:23.420678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca984735bd104bdbb97c8a3b518de0b1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:23.422115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca984735bd104bdbb97c8a3b518de0b1'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:23.529182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1126/2256] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:22 2022] DELETE /identity/v3/users/ca984735bd104bdbb97c8a3b518de0b1 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:23.781146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4a710-2162-48be-9d87-801b89e172c7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:23.782094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4a710-2162-48be-9d87-801b89e172c7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:23.782094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4a710-2162-48be-9d87-801b89e172c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:23.840146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f3e4a710-2162-48be-9d87-801b89e172c7 None None] MFA Rules not processed for user `4f3a2ae8641842008bfd14218b1ac1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:23.841301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f3e4a710-2162-48be-9d87-801b89e172c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:24.008718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1131/2257] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:24.019280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:24.020296 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:24.234617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:24.235864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:24.236339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:24.273905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:24.275853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:24.301223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344c15-9ab2-4e69-b436-b6a960e43979 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:24.327574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:24.328835 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:24.329411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:24.330461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:24.349847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:24.353268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:24.380991 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1127/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:24.456134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1132/2259] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:24.478068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:24.493178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:24.577757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:24.579618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:24.664709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:24.718491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:24.754862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88ef45-6814-4392-b76c-a35f034e1af2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:24.761847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d547d1-6950-4315-87b4-832e7f8068fc service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:24.771219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:24.772294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:24.774588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:24.777741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] PATH_INFO: `/v3/projects/f1c3bbaa3d8545838c0d28ec0a47e4d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:24.779096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6cb39-24b1-4863-8c07-0d345fc83a01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:24.780872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c3bbaa3d8545838c0d28ec0a47e4d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:24.781066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6cb39-24b1-4863-8c07-0d345fc83a01 service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:24.783217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6cb39-24b1-4863-8c07-0d345fc83a01 service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:24.784344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6cb39-24b1-4863-8c07-0d345fc83a01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:24.790042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:24.811123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6cb39-24b1-4863-8c07-0d345fc83a01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:24.818989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6cb39-24b1-4863-8c07-0d345fc83a01 service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:24.850600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1128/2260] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:48:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:48:24.979066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c3bbaa3d8545838c0d28ec0a47e4d0', 'request_id': 'req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:25.098581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c3bbaa3d8545838c0d28ec0a47e4d0', 'request_id': 'req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:25.110749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c3bbaa3d8545838c0d28ec0a47e4d0', 'request_id': 'req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:25.133662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] The token cache is being invalidate because project f1c3bbaa3d8545838c0d28ec0a47e4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:25.133936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:25.135458 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4876db55-ef43-47b4-bbb1-fc9e6229a1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:25.137604 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1133/2261] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:24 2022] DELETE /identity/v3/projects/f1c3bbaa3d8545838c0d28ec0a47e4d0 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:25.144411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ff0ad-c2ee-4e9a-afcd-8d5d609deed1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:25.145208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ff0ad-c2ee-4e9a-afcd-8d5d609deed1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:25.145208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ff0ad-c2ee-4e9a-afcd-8d5d609deed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:25.175095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7d7ff0ad-c2ee-4e9a-afcd-8d5d609deed1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:25.176511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7d7ff0ad-c2ee-4e9a-afcd-8d5d609deed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:25.270377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1129/2262] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:25.272082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326957-1ab7-4778-a08a-0b854e383d0f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:25.272576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326957-1ab7-4778-a08a-0b854e383d0f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:25.272858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326957-1ab7-4778-a08a-0b854e383d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:25.314706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-42326957-1ab7-4778-a08a-0b854e383d0f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:25.318734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-42326957-1ab7-4778-a08a-0b854e383d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:25.342465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1134/2263] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:25.345950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ff0ad-c2ee-4e9a-afcd-8d5d609deed1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:25.360477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ff0ad-c2ee-4e9a-afcd-8d5d609deed1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:25.367088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:25.368080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:25.368514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:25.369029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:25.371011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:25.371535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:25.373841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:25.393033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1130/2264] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:25.397835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42326957-1ab7-4778-a08a-0b854e383d0f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:25.408837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42326957-1ab7-4778-a08a-0b854e383d0f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:25.414062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:25.414926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:25.415220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:25.415557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:25.416612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:25.418890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:25.599546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1135/2265] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:25 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:25.611101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:25.652834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a9021-dbb4-4391-850f-d6ffa2e00acf admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:25.792805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:25.797465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:25.802538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:25.803254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:25.804425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:25.806974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:25.996505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1131/2266] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:25 2022] POST /identity/v3/users => generated 283 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:25.997507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:26.016427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83cb02-3c93-4954-9c90-3b0661518800 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:26.034664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:26.035870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:26.036381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:26.036892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:26.043630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:26.050646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:26.089842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:26.090889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1136/2267] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:26.119963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25973877-f431-49eb-b864-74c413582b2f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:26.141650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f17a-39d6-4cf2-b0ed-ac52629bada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:26.142799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f17a-39d6-4cf2-b0ed-ac52629bada3 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:26.143192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f17a-39d6-4cf2-b0ed-ac52629bada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:26.143629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f17a-39d6-4cf2-b0ed-ac52629bada3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:26.144541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f17a-39d6-4cf2-b0ed-ac52629bada3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:26.146828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f17a-39d6-4cf2-b0ed-ac52629bada3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:26.194708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:26.205726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1132/2268] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:26.207881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db843967-0612-4f76-a6d5-da8b119cc1f4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:26.215586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5606b11-2c5f-415c-8020-66e45e2dcf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:26.217867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606b11-2c5f-415c-8020-66e45e2dcf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:26.218517 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606b11-2c5f-415c-8020-66e45e2dcf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:26.218959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606b11-2c5f-415c-8020-66e45e2dcf4b admin admin] PATH_INFO: `/v3/projects/6cd8c27f22044534a8a426cc7789d4c8/users/235ee073be0344abbf30c6c8cdf14185/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:26.269515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5606b11-2c5f-415c-8020-66e45e2dcf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd8c27f22044534a8a426cc7789d4c8, user_id=235ee073be0344abbf30c6c8cdf14185, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:26.275027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5606b11-2c5f-415c-8020-66e45e2dcf4b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:26.449471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1137/2269] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:26 2022] PUT /identity/v3/projects/6cd8c27f22044534a8a426cc7789d4c8/users/235ee073be0344abbf30c6c8cdf14185/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:26.531315 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:26.531863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:26.531944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:26.578355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] MFA Rules not processed for user `235ee073be0344abbf30c6c8cdf14185`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:26.579744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:26.724670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:26.776563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=2,keystone:INSERT=8 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:26.801125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1133/2270] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:26.896958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d632-30ee-40f3-a4ee-7d17a3e95f9c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:26.897456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d632-30ee-40f3-a4ee-7d17a3e95f9c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:26.897970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d632-30ee-40f3-a4ee-7d17a3e95f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:26.917535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:26.919916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:26.945089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2458d632-30ee-40f3-a4ee-7d17a3e95f9c None None] MFA Rules not processed for user `4f3a2ae8641842008bfd14218b1ac1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:26.946418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2458d632-30ee-40f3-a4ee-7d17a3e95f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:27.022916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f0e61-a358-4d78-9295-1cfc4017f28b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:27.027676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:27.028674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:27.029121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:27.029304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:27.043582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:27.049728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:27.064726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1134/2271] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:27.064726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:27.068559 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:27.077338 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1138/2272] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:27.217550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569f7f3-9090-4344-a26d-d8de5cb51d1a service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:27.223877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:27.224775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:27.225059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:27.225672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] PATH_INFO: `/v3/users/715fec843ead4ec7becb0793a652b252` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:27.227459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] RBAC: Authorizing `identity:delete_user(user_id=715fec843ead4ec7becb0793a652b252)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:27.231913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:27.499174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715fec843ead4ec7becb0793a652b252'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:27.499985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715fec843ead4ec7becb0793a652b252'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:27.516727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715fec843ead4ec7becb0793a652b252'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:27.532913 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715fec843ead4ec7becb0793a652b252'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:27.538397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715fec843ead4ec7becb0793a652b252'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:27.643318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1135/2273] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:27 2022] DELETE /identity/v3/users/715fec843ead4ec7becb0793a652b252 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:27.648809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f550e8-3f87-49be-8d6c-580240bbdd2e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:27.651525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f550e8-3f87-49be-8d6c-580240bbdd2e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:27.653446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f550e8-3f87-49be-8d6c-580240bbdd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:27.694203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-18f550e8-3f87-49be-8d6c-580240bbdd2e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:27.698675 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-18f550e8-3f87-49be-8d6c-580240bbdd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:27.831773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1139/2274] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:27.856502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:27.858713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:27.965108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221445c-1125-491b-8c5a-bb5da824686c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:27.971034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:27.971975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:27.972818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:27.972818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:27.986622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:27.988721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:28.015408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1136/2275] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:28.365483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:28.365953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:28.365953 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:28.410922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] MFA Rules not processed for user `e06fd33c6951412e97117b865414a963`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:28.412826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:28.576393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1140/2276] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:28.602851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:28.606596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:28.633016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:28.634969 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:28.652511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec588c-446d-4aed-a10f-ddc70bc9de5b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:28.660645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:28.662226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:28.663091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:28.663620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] PATH_INFO: `/v3/users/3434dd0c069943e096743781032081b1` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:28.667018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3434dd0c069943e096743781032081b1)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:28.669871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:28.715895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16a23-f429-4d63-946a-75122aa209ff service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:28.725481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:28.725993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:28.726257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:28.733896 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:28.733896 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:28.807737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:28.810059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:28.826371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1137/2277] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:28.882350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:28.885496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:28.927477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad179166-96c9-45d7-baa0-a0a0844115a9 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:28.942191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:28.943168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:28.943453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:28.943919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] PATH_INFO: `/v3/projects/1fcb498cab8c46999ec342932f7b7d82` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:28.945373 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fcb498cab8c46999ec342932f7b7d82)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:28.948030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:28.983297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3434dd0c069943e096743781032081b1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:28.984939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3434dd0c069943e096743781032081b1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.003863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3434dd0c069943e096743781032081b1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.011883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3434dd0c069943e096743781032081b1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.012872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-05dc1437-d7a5-465d-a190-7f848687412c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3434dd0c069943e096743781032081b1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.138187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcb498cab8c46999ec342932f7b7d82', 'request_id': 'req-d65c937d-8087-49e2-93e9-a88bb282b929'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.146171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcb498cab8c46999ec342932f7b7d82', 'request_id': 'req-d65c937d-8087-49e2-93e9-a88bb282b929'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.154148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcb498cab8c46999ec342932f7b7d82', 'request_id': 'req-d65c937d-8087-49e2-93e9-a88bb282b929'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.189092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1141/2278] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:28 2022] DELETE /identity/v3/users/3434dd0c069943e096743781032081b1 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:29.193616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:29.194125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:29.194407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:29.214817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:29.217005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:29.272640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] The token cache is being invalidate because project 1fcb498cab8c46999ec342932f7b7d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:29.272988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.274511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.282765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1138/2279] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:28 2022] DELETE /identity/v3/projects/1fcb498cab8c46999ec342932f7b7d82 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:29.283983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:29.285929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:29.363049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1142/2280] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:29.377217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:29.378843 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:29.390475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c937d-8087-49e2-93e9-a88bb282b929 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:29.397487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:29.398602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:29.398892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:29.399165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] PATH_INFO: `/v3/users/1cd3b09a57c44171806621d366a68da8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:29.401788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd3b09a57c44171806621d366a68da8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:29.403804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:29.469891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc526174-a36a-4b34-847a-385d3b630fcf None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:29.475629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:29.476539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:29.476922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:29.489243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:29.490883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:29.492801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:29.505361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1143/2281] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:29.761486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd3b09a57c44171806621d366a68da8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.762251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd3b09a57c44171806621d366a68da8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.779754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd3b09a57c44171806621d366a68da8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.787702 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd3b09a57c44171806621d366a68da8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.788601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd3b09a57c44171806621d366a68da8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:29.873178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1139/2282] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:29 2022] DELETE /identity/v3/users/1cd3b09a57c44171806621d366a68da8 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:29.880128 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:29.881752 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:29.901749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b27da-33b3-4cee-8e0d-21fc01ed7fe8 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:29.978758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:29.979084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:29.979994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:29.980286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] PATH_INFO: `/v3/projects/da406180feef46568d5f190624bd6947` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:29.982046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da406180feef46568d5f190624bd6947)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:29.983897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:30.161018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da406180feef46568d5f190624bd6947', 'request_id': 'req-aee42e93-7158-458c-aeef-9592e13b6f00'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:30.175080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:30.231013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da406180feef46568d5f190624bd6947', 'request_id': 'req-aee42e93-7158-458c-aeef-9592e13b6f00'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:30.252955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da406180feef46568d5f190624bd6947', 'request_id': 'req-aee42e93-7158-458c-aeef-9592e13b6f00'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:30.259821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:30.287922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] The token cache is being invalidate because project da406180feef46568d5f190624bd6947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:30.288266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:30.293038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aee42e93-7158-458c-aeef-9592e13b6f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:30.296790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1144/2283] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:29 2022] DELETE /identity/v3/projects/da406180feef46568d5f190624bd6947 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:30.676689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:30.678719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:30.712207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c7bd-2586-4623-accd-ae6135beaa2f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:30.777058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:30.778008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:30.778297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:30.778577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] PATH_INFO: `/v3/projects/6a1ed5cfb9034b95ba5c4c8a97e45e68` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:30.779840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1ed5cfb9034b95ba5c4c8a97e45e68)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:30.781861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:30.997377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1ed5cfb9034b95ba5c4c8a97e45e68', 'request_id': 'req-2f49dccb-3411-4f45-996d-4906648bde51'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:31.008887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1ed5cfb9034b95ba5c4c8a97e45e68', 'request_id': 'req-2f49dccb-3411-4f45-996d-4906648bde51'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:31.021511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1ed5cfb9034b95ba5c4c8a97e45e68', 'request_id': 'req-2f49dccb-3411-4f45-996d-4906648bde51'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:31.190727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] The token cache is being invalidate because project 6a1ed5cfb9034b95ba5c4c8a97e45e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:31.191289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:31.192974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2f49dccb-3411-4f45-996d-4906648bde51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:31.197782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1140/2284] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:30 2022] DELETE /identity/v3/projects/6a1ed5cfb9034b95ba5c4c8a97e45e68 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:31.204839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eea08f-aa1a-4d51-bdd5-cef21334a5ec None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:31.205473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eea08f-aa1a-4d51-bdd5-cef21334a5ec None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:31.206144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eea08f-aa1a-4d51-bdd5-cef21334a5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:31.278373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a5eea08f-aa1a-4d51-bdd5-cef21334a5ec None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:31.280122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a5eea08f-aa1a-4d51-bdd5-cef21334a5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:31.427814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1145/2285] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:31.435097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdb06-9238-4ebd-8dd1-94b5406db85e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:31.437573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdb06-9238-4ebd-8dd1-94b5406db85e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:31.437573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdb06-9238-4ebd-8dd1-94b5406db85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:31.483710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-06abdb06-9238-4ebd-8dd1-94b5406db85e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:31.491273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-06abdb06-9238-4ebd-8dd1-94b5406db85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:31.506183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1141/2286] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:31.511627 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eea08f-aa1a-4d51-bdd5-cef21334a5ec None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:31.523349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eea08f-aa1a-4d51-bdd5-cef21334a5ec None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:31.533547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:31.535117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:31.535117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:31.535117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:31.535868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:31.536190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:31.538125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:31.557764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1146/2287] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:31.563877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdb06-9238-4ebd-8dd1-94b5406db85e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:31.576437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdb06-9238-4ebd-8dd1-94b5406db85e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:31.582041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:31.582881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:31.583240 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:31.583615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:31.584470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:31.586744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:31.738667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:31.739569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1142/2288] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:31 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:31.790477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2420d4f-3227-4063-96b9-078b57229166 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:31.909162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:31.910422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:31.910947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:31.911467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:31.912834 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:31.918001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:32.002010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:32.045349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1147/2289] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:31 2022] POST /identity/v3/users => generated 305 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:32.046206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:32.075292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d052ed0-68aa-4b56-8bf7-e09eaa01a713 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:32.090565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:32.092022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:32.093574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:32.093712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:32.094206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:32.096057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:32.099213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:32.139062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1143/2290] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:32.144700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:32.185644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22449ec-d1ed-4427-9489-a4a91d4baf17 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:32.194666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace86c0-8750-46e5-bf54-10ca56824e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:32.198655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace86c0-8750-46e5-bf54-10ca56824e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:32.198655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace86c0-8750-46e5-bf54-10ca56824e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:32.198655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace86c0-8750-46e5-bf54-10ca56824e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:32.198655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace86c0-8750-46e5-bf54-10ca56824e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:32.199638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace86c0-8750-46e5-bf54-10ca56824e03 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:32.232143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1148/2291] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:32.237726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:32.250452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693d86-288e-4817-8756-c795e322a047 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:32.258277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:32.259153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:32.260165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:32.260474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] PATH_INFO: `/v3/projects/ab2c3ef7434f414fabcfdf45503203a5/users/1878c6e69de442faaae7ed7a0188b30e/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:32.284721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2c3ef7434f414fabcfdf45503203a5, user_id=1878c6e69de442faaae7ed7a0188b30e, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:32.287747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:32.414708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1144/2292] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:32 2022] PUT /identity/v3/projects/ab2c3ef7434f414fabcfdf45503203a5/users/1878c6e69de442faaae7ed7a0188b30e/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:32.421369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b92c-e836-4879-96bc-76df6d3af19b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:32.421661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b92c-e836-4879-96bc-76df6d3af19b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:32.421966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b92c-e836-4879-96bc-76df6d3af19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:32.461047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1c33b92c-e836-4879-96bc-76df6d3af19b None None] MFA Rules not processed for user `1878c6e69de442faaae7ed7a0188b30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:32.462524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1c33b92c-e836-4879-96bc-76df6d3af19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:32.608130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1149/2293] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:32.612450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:32.738275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d74ac4-9eef-4083-973d-87fcbec00d4d admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:32.746070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175cda-e82e-445a-8bd7-d097e3ad0928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:32.746770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175cda-e82e-445a-8bd7-d097e3ad0928 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:32.747058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175cda-e82e-445a-8bd7-d097e3ad0928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:32.747340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175cda-e82e-445a-8bd7-d097e3ad0928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:32.748169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175cda-e82e-445a-8bd7-d097e3ad0928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:32.751596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175cda-e82e-445a-8bd7-d097e3ad0928 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:32.891347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1145/2294] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:32 2022] POST /identity/v3/projects => generated 407 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:32.898900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b92c-e836-4879-96bc-76df6d3af19b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:32.948131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b92c-e836-4879-96bc-76df6d3af19b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:33.083647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a19992-96c0-4c3b-8862-ce26e5c98794 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:33.085369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a19992-96c0-4c3b-8862-ce26e5c98794 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:33.086208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a19992-96c0-4c3b-8862-ce26e5c98794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:33.106286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:33.107439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:33.107971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:33.109001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:33.110161 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:33.113139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:33.126060 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f5a19992-96c0-4c3b-8862-ce26e5c98794 None None] MFA Rules not processed for user `f01abef1d27142e9aac438f187b93ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:33.129329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f5a19992-96c0-4c3b-8862-ce26e5c98794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:33.208374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1146/2295] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:33.229122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1150/2296] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:32 2022] POST /identity/v3/users => generated 310 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:33.234997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a19992-96c0-4c3b-8862-ce26e5c98794 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:33.256461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a19992-96c0-4c3b-8862-ce26e5c98794 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:33.282670 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:33.283578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:33.287705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:33.288773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:33.291487 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:33.297840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:33.343179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1147/2297] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:33.347596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:33.365176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84afc5-10f0-466b-bc4a-d4dc73124f87 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:33.395019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:33.395988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:33.396300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:33.396569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] PATH_INFO: `/v3/projects/7656a2a3726c4641a75ad0d03d1a0dba/users/8663e66ab53f4c8b9d41c24103510d08/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:33.448653 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7656a2a3726c4641a75ad0d03d1a0dba, user_id=8663e66ab53f4c8b9d41c24103510d08, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:33.452642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:33.557636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1151/2298] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:33 2022] PUT /identity/v3/projects/7656a2a3726c4641a75ad0d03d1a0dba/users/8663e66ab53f4c8b9d41c24103510d08/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:33.568622 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:33.576403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955b7c0-7ede-4c72-b67e-da7eb118ae98 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:33.689565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d4b68-abc5-4f07-a799-00f6b64e6365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:33.690418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d4b68-abc5-4f07-a799-00f6b64e6365 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:33.698193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d4b68-abc5-4f07-a799-00f6b64e6365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:33.699212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d4b68-abc5-4f07-a799-00f6b64e6365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:33.701263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d4b68-abc5-4f07-a799-00f6b64e6365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:33.703192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d4b68-abc5-4f07-a799-00f6b64e6365 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:33.733644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1148/2299] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:33.738155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:33.769111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff638-5095-414f-9577-6396ac3d6de5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:33.789614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:33.794223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:33.794782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:33.795218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] PATH_INFO: `/v3/projects/7656a2a3726c4641a75ad0d03d1a0dba/users/8663e66ab53f4c8b9d41c24103510d08/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:33.798907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7656a2a3726c4641a75ad0d03d1a0dba, user_id=8663e66ab53f4c8b9d41c24103510d08, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:33.808554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:33.827270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1152/2300] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:33 2022] PUT /identity/v3/projects/7656a2a3726c4641a75ad0d03d1a0dba/users/8663e66ab53f4c8b9d41c24103510d08/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:33.847046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:33.847811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:33.848199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:33.887093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] MFA Rules not processed for user `8663e66ab53f4c8b9d41c24103510d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:33.888674 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:34.041962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1149/2301] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:33 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:34.082388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:34.165307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:34.167376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:34.318270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42c03b-92aa-4cef-b17b-1b5c6e82c3cc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:34.334839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40895311-4676-443b-ac0b-3ccefaa6d445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:34.335532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895311-4676-443b-ac0b-3ccefaa6d445 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:34.339243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895311-4676-443b-ac0b-3ccefaa6d445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:34.339243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40895311-4676-443b-ac0b-3ccefaa6d445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:34.387353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40895311-4676-443b-ac0b-3ccefaa6d445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:34.388879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40895311-4676-443b-ac0b-3ccefaa6d445 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:34.408446 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1153/2302] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:34 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:34.877275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:34.878906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:34.892342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99063c-51c8-4554-9ff8-10ba579ee30c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:34.898923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:34.900481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:34.901092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:34.901529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:35.015683 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:35.018009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:35.031687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1150/2303] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:35.296746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1285c-b6d3-4780-9a62-0f42aea7b27e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:35.297137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1285c-b6d3-4780-9a62-0f42aea7b27e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:35.298073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1285c-b6d3-4780-9a62-0f42aea7b27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:35.314123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:35.322469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-00a1285c-b6d3-4780-9a62-0f42aea7b27e None None] MFA Rules not processed for user `c048ce9cc5484139a3c5f87b4e204809`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:35.323935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-00a1285c-b6d3-4780-9a62-0f42aea7b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:35.388726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1154/2304] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:36.215738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:36.785174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:36.950945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:37.951624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:38.464592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:38.567315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:39.992718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:40.763352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:42.732001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:43.458597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:43.978964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:44.069350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430eaa-f162-4851-95a1-5480dfa2f101 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:44.075638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:44.076843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:44.077204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:44.077554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] PATH_INFO: `/v3/users/1878c6e69de442faaae7ed7a0188b30e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:44.079213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1878c6e69de442faaae7ed7a0188b30e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:44.081367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:44.317722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1878c6e69de442faaae7ed7a0188b30e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:44.318286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1878c6e69de442faaae7ed7a0188b30e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:44.338870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1878c6e69de442faaae7ed7a0188b30e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:44.352651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1878c6e69de442faaae7ed7a0188b30e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:44.354090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1878c6e69de442faaae7ed7a0188b30e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:44.425906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1151/2305] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:43 2022] DELETE /identity/v3/users/1878c6e69de442faaae7ed7a0188b30e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:44.430945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:44.432275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:44.432275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:44.458233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:44.459460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:44.546783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:44.569280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1155/2306] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:44.574520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:44.581171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:44.582939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:44.658784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bf844-c210-4429-838d-e9e985d5cb7c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:44.663274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:44.663915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:44.664179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:44.664459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:44.677327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:44.678898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:44.691123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1152/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:45.599837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:45.601420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:45.619578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9250dd9-3725-40f6-8065-5f43ff1fd196 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:45.626312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:45.631194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:45.631194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:45.631194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] PATH_INFO: `/v3/projects/ab2c3ef7434f414fabcfdf45503203a5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:45.631194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2c3ef7434f414fabcfdf45503203a5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:45.631812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:45.826033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2c3ef7434f414fabcfdf45503203a5', 'request_id': 'req-606e3019-3161-49fb-b0b5-54087475ed0a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:45.950451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2c3ef7434f414fabcfdf45503203a5', 'request_id': 'req-606e3019-3161-49fb-b0b5-54087475ed0a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:45.959122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2c3ef7434f414fabcfdf45503203a5', 'request_id': 'req-606e3019-3161-49fb-b0b5-54087475ed0a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:45.973162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] The token cache is being invalidate because project ab2c3ef7434f414fabcfdf45503203a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:45.973482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:45.974215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:45.975789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1156/2308] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:45 2022] DELETE /identity/v3/projects/ab2c3ef7434f414fabcfdf45503203a5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:45.981301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:45.995226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a19e-32c2-420a-9114-b1f2510470b4 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:46.044009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:46.097963 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:46.098969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:46.099255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:46.099539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] PATH_INFO: `/v3/users/8663e66ab53f4c8b9d41c24103510d08` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:46.100803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8663e66ab53f4c8b9d41c24103510d08)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:46.103297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:47.043554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8663e66ab53f4c8b9d41c24103510d08'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:47.044634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8663e66ab53f4c8b9d41c24103510d08'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:47.069655 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8663e66ab53f4c8b9d41c24103510d08'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:47.079630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8663e66ab53f4c8b9d41c24103510d08'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:47.080458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e3b12832-bfc9-4b37-b0b2-bc037fd9580d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8663e66ab53f4c8b9d41c24103510d08'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:47.111279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:47.178680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1153/2309] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:45 2022] DELETE /identity/v3/users/8663e66ab53f4c8b9d41c24103510d08 => generated 0 bytes in 1198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:47.736327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:47.738799 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:47.757105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e3019-3161-49fb-b0b5-54087475ed0a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:47.850669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:47.853337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:47.853337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:47.853985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] PATH_INFO: `/v3/projects/7656a2a3726c4641a75ad0d03d1a0dba` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:47.855853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7656a2a3726c4641a75ad0d03d1a0dba)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:47.858549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:48.014578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7656a2a3726c4641a75ad0d03d1a0dba', 'request_id': 'req-bf898e41-b858-4afa-8320-79a1b0c8bd5e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:48.122503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7656a2a3726c4641a75ad0d03d1a0dba', 'request_id': 'req-bf898e41-b858-4afa-8320-79a1b0c8bd5e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:48.138266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7656a2a3726c4641a75ad0d03d1a0dba', 'request_id': 'req-bf898e41-b858-4afa-8320-79a1b0c8bd5e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:48.180725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] The token cache is being invalidate because project 7656a2a3726c4641a75ad0d03d1a0dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:48.181798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:48.182836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bf898e41-b858-4afa-8320-79a1b0c8bd5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:48.184544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1157/2310] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:47 2022] DELETE /identity/v3/projects/7656a2a3726c4641a75ad0d03d1a0dba => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:48.191597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4facd3-e31e-4ce7-9223-443a1e392050 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.192254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4facd3-e31e-4ce7-9223-443a1e392050 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.192748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4facd3-e31e-4ce7-9223-443a1e392050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.222307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8c4facd3-e31e-4ce7-9223-443a1e392050 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:48.224095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8c4facd3-e31e-4ce7-9223-443a1e392050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:48.300227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1154/2311] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:48.309070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcad17c-10b6-4129-9ff2-f08982bc3ec0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.309360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcad17c-10b6-4129-9ff2-f08982bc3ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.309635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcad17c-10b6-4129-9ff2-f08982bc3ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.330865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0dcad17c-10b6-4129-9ff2-f08982bc3ec0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:48.332927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0dcad17c-10b6-4129-9ff2-f08982bc3ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:48.340688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1158/2312] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:48.346003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4facd3-e31e-4ce7-9223-443a1e392050 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:48.358841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4facd3-e31e-4ce7-9223-443a1e392050 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:48.363981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:48.364719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.365044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.365366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.366300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:48.366646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:48.368341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:48.382752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1155/2313] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:48.389146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcad17c-10b6-4129-9ff2-f08982bc3ec0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:48.403324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcad17c-10b6-4129-9ff2-f08982bc3ec0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:48.409616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:48.410467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.410846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.411240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.412059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:48.414219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:48.534438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1159/2314] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:48 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:48.536503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:48.570353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789374-4755-421c-a1ea-2c77474a430e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:48.677232 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:48.678707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.679217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.679694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.680784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:48.687630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:48.785797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1156/2315] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:48 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:48.791640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:48.803262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaea362-d1d4-4ea3-86e5-6b088acc13af admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:48.809074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:48.809711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.810069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.810283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.811097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:48.812841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:48.826109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1160/2316] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:48.830385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:48.841725 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349cd54-b308-4313-8048-c226268f5276 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:48.847273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff966-5aa5-4716-92e6-230931dcb161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:48.848000 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff966-5aa5-4716-92e6-230931dcb161 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.848552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff966-5aa5-4716-92e6-230931dcb161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.848864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff966-5aa5-4716-92e6-230931dcb161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.849613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff966-5aa5-4716-92e6-230931dcb161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:48.856349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff966-5aa5-4716-92e6-230931dcb161 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:48.866245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1157/2317] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:48:48.870664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:48.882081 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64d85-3aee-4e75-9430-65ee06df0211 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:48.887870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:48.890688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:48.890688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:48.890688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] PATH_INFO: `/v3/projects/f6ccdbb35a204757861804237f78a044/users/3044b2d65d3943bda2467f295b57c889/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:48.906844 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ccdbb35a204757861804237f78a044, user_id=3044b2d65d3943bda2467f295b57c889, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:48.909670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:49.019495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1161/2318] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:48 2022] PUT /identity/v3/projects/f6ccdbb35a204757861804237f78a044/users/3044b2d65d3943bda2467f295b57c889/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:49.032708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24e8b-5767-424e-b74a-17c61869e233 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:49.033088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24e8b-5767-424e-b74a-17c61869e233 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:49.033376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24e8b-5767-424e-b74a-17c61869e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:49.065763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-91b24e8b-5767-424e-b74a-17c61869e233 None None] MFA Rules not processed for user `3044b2d65d3943bda2467f295b57c889`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:49.066962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-91b24e8b-5767-424e-b74a-17c61869e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:49.165246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1158/2319] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:48:49.170927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:49.254894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:49.332730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea466-3ba8-432c-9df6-8e37b093f55f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:49.340033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:49.340854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:49.341264 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:49.341712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:49.342553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:49.344665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:49.455746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1162/2320] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:49 2022] POST /identity/v3/projects => generated 383 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:49.460359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b24e8b-5767-424e-b74a-17c61869e233 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:49.476380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b24e8b-5767-424e-b74a-17c61869e233 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:49.560163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:49.598649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:49.604620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:49.604620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:49.604620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:49.604620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:49.604620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:49.736113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1159/2321] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:49 2022] POST /identity/v3/users => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:49.740655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:49.754046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7ecd-a741-4f71-84d0-93b4732ba302 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:49.759272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:49.760518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:49.760864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:49.761140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:49.761944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:49.763894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:49.776595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1163/2322] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:49.781461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:49.793988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e65a7-faa1-45f3-951f-202f750c195a admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:49.800245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:49.801201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:49.801598 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:49.801969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] PATH_INFO: `/v3/projects/bbbb1b932c4e4c78a52c64c308e72927/users/7d4f2b2a512749caa752cb3eade1040c/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:49.820419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbb1b932c4e4c78a52c64c308e72927, user_id=7d4f2b2a512749caa752cb3eade1040c, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:49.823454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:49.940442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1160/2323] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:49 2022] PUT /identity/v3/projects/bbbb1b932c4e4c78a52c64c308e72927/users/7d4f2b2a512749caa752cb3eade1040c/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:49.945047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:49.959164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1a64e-6fe9-4848-9851-b4564bcefa50 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:50.051044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e542-4d69-4cf2-91be-7078ffe7c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:50.051870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e542-4d69-4cf2-91be-7078ffe7c6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:50.052160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e542-4d69-4cf2-91be-7078ffe7c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:50.052506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e542-4d69-4cf2-91be-7078ffe7c6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:50.053310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e542-4d69-4cf2-91be-7078ffe7c6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:50.055138 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e542-4d69-4cf2-91be-7078ffe7c6b0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:50.068183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1164/2324] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:50.072746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:50.086018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2cb04-4832-44be-8ed6-5633d60b78cf admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:50.092715 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:50.094904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:50.095239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:50.095788 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] PATH_INFO: `/v3/projects/bbbb1b932c4e4c78a52c64c308e72927/users/7d4f2b2a512749caa752cb3eade1040c/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:50.099057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbb1b932c4e4c78a52c64c308e72927, user_id=7d4f2b2a512749caa752cb3eade1040c, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:50.103701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:50.120778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1161/2325] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:50 2022] PUT /identity/v3/projects/bbbb1b932c4e4c78a52c64c308e72927/users/7d4f2b2a512749caa752cb3eade1040c/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:50.133652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f54ef-6c66-4c1e-9bfe-815644fd6ea2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:50.134623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f54ef-6c66-4c1e-9bfe-815644fd6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:50.134623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f54ef-6c66-4c1e-9bfe-815644fd6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:50.178322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b01f54ef-6c66-4c1e-9bfe-815644fd6ea2 None None] MFA Rules not processed for user `7d4f2b2a512749caa752cb3eade1040c`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:50.179617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b01f54ef-6c66-4c1e-9bfe-815644fd6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:50.271160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1165/2326] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:50.283531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:50.285624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:50.375414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338ffba-1d18-4a89-839b-7a3b4b51f49b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:50.383741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:50.384922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:50.386156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:50.386156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:50.398573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:50.400660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:50.418720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1162/2327] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:50.840124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f54ef-6c66-4c1e-9bfe-815644fd6ea2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:50.851251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f54ef-6c66-4c1e-9bfe-815644fd6ea2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:50.855868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f1720-61a6-41f1-bae3-211639a987cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:50.857009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1720-61a6-41f1-bae3-211639a987cc service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:50.857302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1720-61a6-41f1-bae3-211639a987cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:50.857581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1720-61a6-41f1-bae3-211639a987cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:50.905859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:50.922797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f1720-61a6-41f1-bae3-211639a987cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:50.924603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f1720-61a6-41f1-bae3-211639a987cc service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:50.935445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1166/2328] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:48:51.004264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:51.637181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:51.715371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac98d7-4ca9-4f34-af22-2033fa28f076 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:51.721309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:51.722238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:51.722647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:51.722959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] PATH_INFO: `/v3/users/3044b2d65d3943bda2467f295b57c889` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:51.724187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3044b2d65d3943bda2467f295b57c889)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:51.726198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:51.967473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3044b2d65d3943bda2467f295b57c889'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:51.969539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3044b2d65d3943bda2467f295b57c889'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:52.003827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3044b2d65d3943bda2467f295b57c889'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:52.023651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3044b2d65d3943bda2467f295b57c889'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:52.023651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3044b2d65d3943bda2467f295b57c889'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:52.142744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1163/2329] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:51 2022] DELETE /identity/v3/users/3044b2d65d3943bda2467f295b57c889 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:52.149046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:52.149734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:52.150994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:52.177715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:52.179290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:52.266843 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1167/2330] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:52.278914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:52.281056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:52.290200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:52.370509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc856-d74b-4155-aac1-97d24f174477 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:52.374861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:52.375952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:52.375952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:52.376228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:52.380688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:52.391478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:52.393437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:52.405636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1164/2331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:52.974842 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:53.013707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:53.018861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:53.069733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f49a0-9259-4e5b-be1d-288a70f83b29 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:53.090873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:53.090873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:53.090873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:53.091411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] PATH_INFO: `/v3/projects/f6ccdbb35a204757861804237f78a044` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:53.094759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ccdbb35a204757861804237f78a044)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:53.099685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:53.249017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ccdbb35a204757861804237f78a044', 'request_id': 'req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.323554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ccdbb35a204757861804237f78a044', 'request_id': 'req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.335622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ccdbb35a204757861804237f78a044', 'request_id': 'req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.350451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] The token cache is being invalidate because project f6ccdbb35a204757861804237f78a044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:53.350905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.351738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.354114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1168/2332] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:53 2022] DELETE /identity/v3/projects/f6ccdbb35a204757861804237f78a044 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:53.358528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:53.362992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:53.374590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de329765-f47c-44be-bb02-696e5a9cf9b2 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:53.447241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:53.448982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:53.449346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:53.449771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] PATH_INFO: `/v3/users/7d4f2b2a512749caa752cb3eade1040c` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:53.451468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d4f2b2a512749caa752cb3eade1040c)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:53.454047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:53.574339 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:53.695244 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d4f2b2a512749caa752cb3eade1040c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.696186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d4f2b2a512749caa752cb3eade1040c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.724289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d4f2b2a512749caa752cb3eade1040c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.738065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d4f2b2a512749caa752cb3eade1040c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.739168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-05c68ac0-2c44-44e3-a91f-cd8ebb146f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d4f2b2a512749caa752cb3eade1040c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:53.875376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1165/2333] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:48:53 2022] DELETE /identity/v3/users/7d4f2b2a512749caa752cb3eade1040c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:54.482655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:54.486414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:54.507817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ec1b-473f-416f-abe3-1cdd9cf4e1b9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:54.594362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:54.632760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:54.633832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:54.635944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:54.636665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] PATH_INFO: `/v3/projects/bbbb1b932c4e4c78a52c64c308e72927` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:54.638972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbb1b932c4e4c78a52c64c308e72927)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:54.641160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:54.808068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbb1b932c4e4c78a52c64c308e72927', 'request_id': 'req-777cbae3-a2bf-4d19-95ef-027fecf804b4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:54.911052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbb1b932c4e4c78a52c64c308e72927', 'request_id': 'req-777cbae3-a2bf-4d19-95ef-027fecf804b4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:54.920697 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbb1b932c4e4c78a52c64c308e72927', 'request_id': 'req-777cbae3-a2bf-4d19-95ef-027fecf804b4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:54.935004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] The token cache is being invalidate because project bbbb1b932c4e4c78a52c64c308e72927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:48:54.935279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:54.935964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-777cbae3-a2bf-4d19-95ef-027fecf804b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:48:54.938689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1169/2334] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:48:54 2022] DELETE /identity/v3/projects/bbbb1b932c4e4c78a52c64c308e72927 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:48:54.944563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c0074-5219-4a0d-89fa-1a6969f86d9c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:54.945402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c0074-5219-4a0d-89fa-1a6969f86d9c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:54.945402 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c0074-5219-4a0d-89fa-1a6969f86d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:54.972458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c65c0074-5219-4a0d-89fa-1a6969f86d9c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:54.973869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c65c0074-5219-4a0d-89fa-1a6969f86d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:55.063833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:55.086283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1166/2335] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:55.096266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8b39-ad26-4d20-83ac-3edaeedc6d13 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.096606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8b39-ad26-4d20-83ac-3edaeedc6d13 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.096888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8b39-ad26-4d20-83ac-3edaeedc6d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.120295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c96b8b39-ad26-4d20-83ac-3edaeedc6d13 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:55.121549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c96b8b39-ad26-4d20-83ac-3edaeedc6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:55.130649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1170/2336] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:55.137596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c0074-5219-4a0d-89fa-1a6969f86d9c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:55.159804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c0074-5219-4a0d-89fa-1a6969f86d9c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:55.168978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:55.170175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.170634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.171599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.172571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:48:55.173092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:55.175313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:55.191959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1167/2337] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:48:55.199940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8b39-ad26-4d20-83ac-3edaeedc6d13 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:55.214301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8b39-ad26-4d20-83ac-3edaeedc6d13 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:55.221137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:55.222343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.222854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.223332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.224718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:55.229141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:55.377152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1171/2338] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:55 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:48:55.382366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:55.399040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0180-b312-40e4-a80e-fffd9b47805d admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:55.475860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:55.476562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.476850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.477129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.477993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:55.480294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:55.581959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1168/2339] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:55 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:55.586791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:55.599094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28084-aaf9-4368-966a-96b53680f901 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:55.606740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:55.608001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.608642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.609216 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.611203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:55.615110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:55.636864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1172/2340] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:55.641470 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:55.654732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc510a-b62c-42bf-8f6d-ce9e4a42241a admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:55.660902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb91a08-d272-4256-a9bc-63a31092684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:55.661925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb91a08-d272-4256-a9bc-63a31092684e admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.662209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb91a08-d272-4256-a9bc-63a31092684e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.662630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb91a08-d272-4256-a9bc-63a31092684e admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.663273 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb91a08-d272-4256-a9bc-63a31092684e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:55.664985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb91a08-d272-4256-a9bc-63a31092684e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:55.684104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1169/2341] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:55.689298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:55.712713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2709-809b-47d8-8cc7-b63f57f7c83b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:55.727480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:55.730011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.730847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.731367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] PATH_INFO: `/v3/projects/3227e9a77104498d829f72264538706e/users/d10fb9ba437c423e883c55f031c503a3/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.761880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3227e9a77104498d829f72264538706e, user_id=d10fb9ba437c423e883c55f031c503a3, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:55.768606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:55.958249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1173/2342] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:55 2022] PUT /identity/v3/projects/3227e9a77104498d829f72264538706e/users/d10fb9ba437c423e883c55f031c503a3/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:48:55.965717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb39c-90bb-4796-bf49-b4556ef0d45e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:55.966844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb39c-90bb-4796-bf49-b4556ef0d45e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:55.968763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb39c-90bb-4796-bf49-b4556ef0d45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:55.994971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-db7eb39c-90bb-4796-bf49-b4556ef0d45e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:55.996414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-db7eb39c-90bb-4796-bf49-b4556ef0d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:56.069395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1170/2343] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:56.080515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:56.082544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:56.183351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d80006-b8b2-47db-9aea-5a4c9085e145 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:56.187166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72b09e-48a8-4c1a-ac62-5d198aee5dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:56.187878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72b09e-48a8-4c1a-ac62-5d198aee5dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:56.188234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72b09e-48a8-4c1a-ac62-5d198aee5dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:56.188513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72b09e-48a8-4c1a-ac62-5d198aee5dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:56.202237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72b09e-48a8-4c1a-ac62-5d198aee5dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:56.203694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72b09e-48a8-4c1a-ac62-5d198aee5dbd service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:56.216702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1174/2344] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:48:56.495375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a02f0-b37f-4f91-a355-df8b9895f626 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:56.495932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a02f0-b37f-4f91-a355-df8b9895f626 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:56.496354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a02f0-b37f-4f91-a355-df8b9895f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:56.523004 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-010a02f0-b37f-4f91-a355-df8b9895f626 None None] MFA Rules not processed for user `4f3a2ae8641842008bfd14218b1ac1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:56.524942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-010a02f0-b37f-4f91-a355-df8b9895f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:56.609242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1171/2345] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:59.232246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0635-1e01-4fd1-9bf2-4e13e43bc435 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:59.232987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0635-1e01-4fd1-9bf2-4e13e43bc435 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:59.232987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0635-1e01-4fd1-9bf2-4e13e43bc435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:59.267859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:59.300417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e22b0635-1e01-4fd1-9bf2-4e13e43bc435 None None] MFA Rules not processed for user `d10fb9ba437c423e883c55f031c503a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:48:59.301737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e22b0635-1e01-4fd1-9bf2-4e13e43bc435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:48:59.443469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1175/2346] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:48:59.448661 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a02f0-b37f-4f91-a355-df8b9895f626 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:59.455419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:59.463221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a02f0-b37f-4f91-a355-df8b9895f626 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:59.470225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:59.473327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:59.474195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:59.475264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:59.476268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:59.479774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:59.604044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1172/2347] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:48:59 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:59.610249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0635-1e01-4fd1-9bf2-4e13e43bc435 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:59.628912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0635-1e01-4fd1-9bf2-4e13e43bc435 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:59.725737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:59.726590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:59.726889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:59.727193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:59.728668 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:59.730595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:59.828452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1176/2348] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:48:59 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:48:59.844673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:59.863316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335653ea-ec21-4757-a5df-eff9a2e6758b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:59.870762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:48:59.872034 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:48:59.872525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:48:59.872996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:48:59.873980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:48:59.882648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:48:59.931602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1173/2349] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:48:59.954976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:48:59.985631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e9f68-1be6-4f88-bd00-d9850636fe48 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:48:59.999059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:00.000812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:00.001315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:00.002676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] PATH_INFO: `/v3/projects/70ac7052e3bc427499db954129156632/users/e71454185a764dd892da7a6d80820e41/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:00.052252 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ac7052e3bc427499db954129156632, user_id=e71454185a764dd892da7a6d80820e41, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:00.055496 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:00.245503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1177/2350] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:48:59 2022] PUT /identity/v3/projects/70ac7052e3bc427499db954129156632/users/e71454185a764dd892da7a6d80820e41/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:49:00.251166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:00.265870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b863144-a4d6-4cc6-87e8-1b35ff351385 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:00.343804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3499436-54dc-493c-9ccc-d84c13ed6c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:00.344173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3499436-54dc-493c-9ccc-d84c13ed6c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:00.344440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3499436-54dc-493c-9ccc-d84c13ed6c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:00.344853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3499436-54dc-493c-9ccc-d84c13ed6c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:00.345548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3499436-54dc-493c-9ccc-d84c13ed6c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:00.347201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3499436-54dc-493c-9ccc-d84c13ed6c02 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:00.364270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1174/2351] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:49:00.368889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:00.382500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650054-17f9-4446-9818-d6972e503669 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:00.390320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6a19a-4108-4ca7-9c2c-de0772987939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:00.391651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a19a-4108-4ca7-9c2c-de0772987939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:00.392144 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a19a-4108-4ca7-9c2c-de0772987939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:00.392633 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a19a-4108-4ca7-9c2c-de0772987939 admin admin] PATH_INFO: `/v3/projects/70ac7052e3bc427499db954129156632/users/e71454185a764dd892da7a6d80820e41/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:00.395896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6a19a-4108-4ca7-9c2c-de0772987939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ac7052e3bc427499db954129156632, user_id=e71454185a764dd892da7a6d80820e41, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:00.399506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6a19a-4108-4ca7-9c2c-de0772987939 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:00.414185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1178/2352] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:49:00 2022] PUT /identity/v3/projects/70ac7052e3bc427499db954129156632/users/e71454185a764dd892da7a6d80820e41/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:49:02.543637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:02.544108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:02.544237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:02.604691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] MFA Rules not processed for user `e71454185a764dd892da7a6d80820e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:02.608735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:02.732051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1175/2353] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:49:02.748507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:02.749984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:02.750501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:02.782456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] MFA Rules not processed for user `d10fb9ba437c423e883c55f031c503a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:02.784725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:02.865380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:02.888109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1179/2354] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:49:02.903445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:02.905887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:02.986875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:03.013938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2dfc-f8a5-450d-bd30-d2f6c835146c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:03.023012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:03.023549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:03.023838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:03.024166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:03.034799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:03.036700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:03.052863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1176/2355] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:49:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:49:11.803745 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:11.806657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:11.921841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35e63-3611-4e70-9cfa-ea74b03d0c75 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:11.933055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba3bd-eb6d-4d69-9eb7-8c97ee3ed434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:11.934445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba3bd-eb6d-4d69-9eb7-8c97ee3ed434 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:11.945947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba3bd-eb6d-4d69-9eb7-8c97ee3ed434 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:11.945947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba3bd-eb6d-4d69-9eb7-8c97ee3ed434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:11.945947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e7aba3bd-eb6d-4d69-9eb7-8c97ee3ed434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:11.958293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba3bd-eb6d-4d69-9eb7-8c97ee3ed434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:11.960244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba3bd-eb6d-4d69-9eb7-8c97ee3ed434 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:11.977287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1180/2356] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:49:13.525023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=11 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:19.899383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:19.901636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:20.024205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3c43b-49c5-427a-af23-8ced330efd71 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:20.029823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:20.030887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:20.031266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:20.033225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] PATH_INFO: `/v3/users/235ee073be0344abbf30c6c8cdf14185` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:20.033225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235ee073be0344abbf30c6c8cdf14185)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:20.035405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:20.341168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235ee073be0344abbf30c6c8cdf14185'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:20.343168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235ee073be0344abbf30c6c8cdf14185'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:20.379011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235ee073be0344abbf30c6c8cdf14185'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:20.404476 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235ee073be0344abbf30c6c8cdf14185'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:20.405667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235ee073be0344abbf30c6c8cdf14185'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:20.538950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1177/2357] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:49:19 2022] DELETE /identity/v3/users/235ee073be0344abbf30c6c8cdf14185 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:49:20.542333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:20.543206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:20.543379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:20.599765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:20.603075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:20.715926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1181/2358] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:49:20.731882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:20.733900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:20.812110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34df16-3182-4d44-bedc-abcc89d66895 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:20.818676 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c43f98-5380-4c0a-80ce-796301caacdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:20.819891 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c43f98-5380-4c0a-80ce-796301caacdf service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:20.820412 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c43f98-5380-4c0a-80ce-796301caacdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:20.820889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c43f98-5380-4c0a-80ce-796301caacdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:20.838522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c43f98-5380-4c0a-80ce-796301caacdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:20.840076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c43f98-5380-4c0a-80ce-796301caacdf service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:20.851277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1178/2359] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:49:21.707319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:21.713042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:21.737063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429da0b-bb06-4741-a205-7ebaa406e968 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:21.756923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:21.758298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:21.759388 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:21.760067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] PATH_INFO: `/v3/projects/6cd8c27f22044534a8a426cc7789d4c8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:21.773444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd8c27f22044534a8a426cc7789d4c8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:21.779103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:21.933376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd8c27f22044534a8a426cc7789d4c8', 'request_id': 'req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:22.088008 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd8c27f22044534a8a426cc7789d4c8', 'request_id': 'req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:22.096304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd8c27f22044534a8a426cc7789d4c8', 'request_id': 'req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:22.115077 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] The token cache is being invalidate because project 6cd8c27f22044534a8a426cc7789d4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:49:22.115530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:22.116481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee46c3b4-b72d-4bbe-ad8f-91a0893b99d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:22.118623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1182/2360] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:49:21 2022] DELETE /identity/v3/projects/6cd8c27f22044534a8a426cc7789d4c8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:49:22.126357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4210153-3e26-4c15-b7e5-d06736237e6b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:22.132971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4210153-3e26-4c15-b7e5-d06736237e6b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:22.132971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4210153-3e26-4c15-b7e5-d06736237e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:22.150767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e4210153-3e26-4c15-b7e5-d06736237e6b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:22.152456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e4210153-3e26-4c15-b7e5-d06736237e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:22.179829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:22.254131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1179/2361] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:49:22.265169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552dc9-a527-4e2b-8a3c-43f8f749b9fa None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:22.265580 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552dc9-a527-4e2b-8a3c-43f8f749b9fa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:22.266120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552dc9-a527-4e2b-8a3c-43f8f749b9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:22.275761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:22.289189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e8552dc9-a527-4e2b-8a3c-43f8f749b9fa None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:22.291952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e8552dc9-a527-4e2b-8a3c-43f8f749b9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:22.305105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1183/2362] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:49:22.310812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4210153-3e26-4c15-b7e5-d06736237e6b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:22.325001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4210153-3e26-4c15-b7e5-d06736237e6b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:22.333076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:22.334275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:22.334778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:22.335282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:22.336784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:49:22.337921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:22.340010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:22.356142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1180/2363] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:49:22.361120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552dc9-a527-4e2b-8a3c-43f8f749b9fa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:22.371669 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552dc9-a527-4e2b-8a3c-43f8f749b9fa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:22.377444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:22.378230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:22.378520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:22.378794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:22.379527 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:22.381515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:22.633228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1184/2364] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:49:22 2022] POST /identity/v3/projects => generated 397 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:49:22.638471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:22.651606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eee42-26d0-45b8-8999-e59fcae92739 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:22.754259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:22.754972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:22.755214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:22.755499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:22.756249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:22.758248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:22.867746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1181/2365] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:49:22 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:49:22.876772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:22.895217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb23e-58dd-4075-84da-242dbbc95ab7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:22.907343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:22.908645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:22.909959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:22.910537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:22.911984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:22.916177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:22.939796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1185/2366] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:49:22.940977 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:22.956704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b1c0-523f-4d52-8074-dae91aded69b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:22.969477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab949f0c-d4b2-477e-99bf-a6693d6a9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:22.970520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949f0c-d4b2-477e-99bf-a6693d6a9b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:22.978141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949f0c-d4b2-477e-99bf-a6693d6a9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:22.978141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949f0c-d4b2-477e-99bf-a6693d6a9b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:22.978141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab949f0c-d4b2-477e-99bf-a6693d6a9b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:22.978141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab949f0c-d4b2-477e-99bf-a6693d6a9b9c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:22.996785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1182/2367] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:49:22.998313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:23.016531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5a504-2e86-4b48-a989-22e907fcfdef admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:23.025139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:23.026687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:23.027371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:23.027858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] PATH_INFO: `/v3/projects/2feff67ce6614579a99fb311e788000d/users/91c6d34f41aa40ef94be63a2ac6a7fc8/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:23.056817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2feff67ce6614579a99fb311e788000d, user_id=91c6d34f41aa40ef94be63a2ac6a7fc8, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:23.062825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:23.211116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1186/2368] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:49:22 2022] PUT /identity/v3/projects/2feff67ce6614579a99fb311e788000d/users/91c6d34f41aa40ef94be63a2ac6a7fc8/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:49:23.231050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f71aac-d72e-44a7-b045-4a40334f00e1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:23.231837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f71aac-d72e-44a7-b045-4a40334f00e1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:23.232387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f71aac-d72e-44a7-b045-4a40334f00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:23.299093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-70f71aac-d72e-44a7-b045-4a40334f00e1 None None] MFA Rules not processed for user `91c6d34f41aa40ef94be63a2ac6a7fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:23.301721 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-70f71aac-d72e-44a7-b045-4a40334f00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:23.408814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1183/2369] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:49:23.422088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:23.423895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:23.491714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e934d-3066-48b0-95f9-63c77cf61079 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:23.496705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b585ec0-9ebc-48da-9c6d-3a57af5ea200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:23.497531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b585ec0-9ebc-48da-9c6d-3a57af5ea200 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:23.497868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b585ec0-9ebc-48da-9c6d-3a57af5ea200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:23.498150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b585ec0-9ebc-48da-9c6d-3a57af5ea200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:23.508245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b585ec0-9ebc-48da-9c6d-3a57af5ea200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:23.510442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b585ec0-9ebc-48da-9c6d-3a57af5ea200 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:23.522104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1187/2370] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:49:30.138852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f71aac-d72e-44a7-b045-4a40334f00e1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:30.168349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:30.239403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f71aac-d72e-44a7-b045-4a40334f00e1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:30.244640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:30.245606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:30.245940 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:30.246246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] PATH_INFO: `/v3/users/91c6d34f41aa40ef94be63a2ac6a7fc8` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:30.247677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c6d34f41aa40ef94be63a2ac6a7fc8)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:30.249831 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:30.572284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c6d34f41aa40ef94be63a2ac6a7fc8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:30.573144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c6d34f41aa40ef94be63a2ac6a7fc8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:30.595879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c6d34f41aa40ef94be63a2ac6a7fc8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:30.607821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c6d34f41aa40ef94be63a2ac6a7fc8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:30.608816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c6d34f41aa40ef94be63a2ac6a7fc8'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:30.695624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1184/2371] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:49:30 2022] DELETE /identity/v3/users/91c6d34f41aa40ef94be63a2ac6a7fc8 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:49:30.701757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bffca-cbcb-4c97-aead-0d9b6799376e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:30.706978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bffca-cbcb-4c97-aead-0d9b6799376e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:30.706978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bffca-cbcb-4c97-aead-0d9b6799376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:30.731608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b20bffca-cbcb-4c97-aead-0d9b6799376e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:30.733565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b20bffca-cbcb-4c97-aead-0d9b6799376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:30.839970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1188/2372] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:49:30.850003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:30.851959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:30.937093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bffca-cbcb-4c97-aead-0d9b6799376e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:30.944321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182850d-91ac-4ab2-91f5-36a76345c06b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:30.951992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:30.953465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:30.953465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:30.956814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:30.956966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bffca-cbcb-4c97-aead-0d9b6799376e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:30.962927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ced8f-3dfc-4733-be87-72ffbd30ac54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:30.963999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ced8f-3dfc-4733-be87-72ffbd30ac54 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:30.964470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ced8f-3dfc-4733-be87-72ffbd30ac54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:30.965329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ced8f-3dfc-4733-be87-72ffbd30ac54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:30.969728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-368ced8f-3dfc-4733-be87-72ffbd30ac54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:30.988293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:30.991547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:31.026511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1185/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:49:31.072073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:31.110440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ced8f-3dfc-4733-be87-72ffbd30ac54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:31.113715 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ced8f-3dfc-4733-be87-72ffbd30ac54 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:31.143326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1189/2374] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:49:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:49:32.122955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:32.122955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:32.144468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45184-f9b8-4d1f-a8e6-f19984f06a39 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:32.153039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:32.154047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:32.154358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:32.154867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] PATH_INFO: `/v3/projects/2feff67ce6614579a99fb311e788000d` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:32.157426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2feff67ce6614579a99fb311e788000d)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:32.161354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:32.344526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:32.369318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2feff67ce6614579a99fb311e788000d', 'request_id': 'req-9fcca104-3332-4429-9ec6-a9895fec960b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:32.377953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2feff67ce6614579a99fb311e788000d', 'request_id': 'req-9fcca104-3332-4429-9ec6-a9895fec960b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:32.387529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2feff67ce6614579a99fb311e788000d', 'request_id': 'req-9fcca104-3332-4429-9ec6-a9895fec960b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:32.510753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] The token cache is being invalidate because project 2feff67ce6614579a99fb311e788000d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:49:32.511048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:32.511993 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:49:32.513886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1186/2375] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:49:32 2022] DELETE /identity/v3/projects/2feff67ce6614579a99fb311e788000d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:49:36.329424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:36.338747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:36.338747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:36.350772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:36.352127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:36.420641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1190/2376] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:49:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:49:36.583740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:36.585349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:36.677309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcca104-3332-4429-9ec6-a9895fec960b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:36.683704 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062be665-5da4-4b31-8274-edab1d6f4076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:36.683925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:36.684393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062be665-5da4-4b31-8274-edab1d6f4076 service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:36.684681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062be665-5da4-4b31-8274-edab1d6f4076 service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:36.684966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062be665-5da4-4b31-8274-edab1d6f4076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:36.685421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:36.695230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062be665-5da4-4b31-8274-edab1d6f4076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:36.697528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062be665-5da4-4b31-8274-edab1d6f4076 service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:36.708687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1187/2377] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:49:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:49:36.759145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6665ea1-29e2-40f6-9152-d80d0f31ca03 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:36.764744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:36.765565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:36.765968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:36.766340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:36.768444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:36.878746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:36.880812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:36.895620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1191/2378] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:49:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:49:40.147522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc9fc-c563-426f-b589-f5c951a4595b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:40.148658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc9fc-c563-426f-b589-f5c951a4595b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:40.148658 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc9fc-c563-426f-b589-f5c951a4595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:40.173485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-951fc9fc-c563-426f-b589-f5c951a4595b None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:49:40.174974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-951fc9fc-c563-426f-b589-f5c951a4595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:49:40.187555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1188/2379] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:49:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:49:40.208765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:49:40.223475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43893-e248-4bef-b935-f17e693de28c service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:49:40.231234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:49:40.232093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:49:40.232742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:49:40.233107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:49:40.244569 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:49:40.246277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:49:40.260415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1192/2380] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:49:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:49:50.166766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=5,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:50.253559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:01.816445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:01.816932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:01.817023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:01.837374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:01.838710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:01.846284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1189/2381] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 08:50:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:01.859255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:01.870425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f76ad6-8166-4fde-a2d2-ee565c7d4900 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:01.875687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958e04b-b0e2-425d-8db8-677cb751cda2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:01.876339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958e04b-b0e2-425d-8db8-677cb751cda2 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:01.876621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958e04b-b0e2-425d-8db8-677cb751cda2 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:01.876902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958e04b-b0e2-425d-8db8-677cb751cda2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:01.886465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958e04b-b0e2-425d-8db8-677cb751cda2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:01.888076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958e04b-b0e2-425d-8db8-677cb751cda2 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:01.897125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1193/2382] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:50:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:50:05.449719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:05.452464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:05.544486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb725ae-0f47-4265-8cdb-f96ade60d404 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:05.549935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:05.550754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:05.551041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:05.551321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] PATH_INFO: `/v3/users/4f3a2ae8641842008bfd14218b1ac1e6` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:05.552742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3a2ae8641842008bfd14218b1ac1e6)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:05.555430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:05.719647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e126-ce4a-4ec0-b0d3-213473d2d33b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:05.720328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e126-ce4a-4ec0-b0d3-213473d2d33b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:05.720659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e126-ce4a-4ec0-b0d3-213473d2d33b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:05.723484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1194/2383] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:50:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:50:05.731311 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:05.731668 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:05.731947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:05.755168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:05.756487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:05.790437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3a2ae8641842008bfd14218b1ac1e6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:05.791677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3a2ae8641842008bfd14218b1ac1e6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:05.825929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3a2ae8641842008bfd14218b1ac1e6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:05.834425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3a2ae8641842008bfd14218b1ac1e6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:05.835602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3a2ae8641842008bfd14218b1ac1e6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:05.865852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1195/2384] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:05.884029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:05.886101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:05.944541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1190/2385] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:05 2022] DELETE /identity/v3/users/4f3a2ae8641842008bfd14218b1ac1e6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:50:05.994616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701f4ce-e4e9-421f-aaaa-48a82c6fdd8b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:06.075056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d8b40-c408-467c-977a-9eaa47a2c51e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:06.075990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8b40-c408-467c-977a-9eaa47a2c51e service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.076260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8b40-c408-467c-977a-9eaa47a2c51e service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.076539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8b40-c408-467c-977a-9eaa47a2c51e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.122483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:06.191644 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d8b40-c408-467c-977a-9eaa47a2c51e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:06.193169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d8b40-c408-467c-977a-9eaa47a2c51e service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:06.206368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1196/2386] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:50:06.313434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:06.315400 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:06.404472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67924b5e-ef6f-45bb-9f2c-c51bfb9d3d5b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.404768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67924b5e-ef6f-45bb-9f2c-c51bfb9d3d5b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.405198 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67924b5e-ef6f-45bb-9f2c-c51bfb9d3d5b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.406891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1197/2387] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:50:06.414125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.414495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.414910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.423464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886fe9-776a-4749-a24d-8e1d20c839bf admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:06.429157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:06.430259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.430544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.430822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] PATH_INFO: `/v3/projects/1db518a7c0264906a196bbc05a84a08c` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.432140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db518a7c0264906a196bbc05a84a08c)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:06.434180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:06.436637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] MFA Rules not processed for user `b40cb94150444c81ab1de3c6c1c1ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:06.438166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:06.454153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:06.501472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1198/2388] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:06.514026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:06.514026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:06.525247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6857-8d12-4fc3-88b5-02d4c98154af None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:06.533145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c313-b241-4cf9-99c8-246549242a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:06.533847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c313-b241-4cf9-99c8-246549242a9e service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.534137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c313-b241-4cf9-99c8-246549242a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.534415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c313-b241-4cf9-99c8-246549242a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.545638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c313-b241-4cf9-99c8-246549242a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:06.547873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c313-b241-4cf9-99c8-246549242a9e service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:06.558782 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1199/2389] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:50:06.601936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db518a7c0264906a196bbc05a84a08c', 'request_id': 'req-159af659-6a9e-4d0a-b40a-3bce4d48c65a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:06.611953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db518a7c0264906a196bbc05a84a08c', 'request_id': 'req-159af659-6a9e-4d0a-b40a-3bce4d48c65a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:06.631449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db518a7c0264906a196bbc05a84a08c', 'request_id': 'req-159af659-6a9e-4d0a-b40a-3bce4d48c65a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:06.670385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07352-dee9-4b60-8397-06d9a75ecd5d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.670679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07352-dee9-4b60-8397-06d9a75ecd5d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.674152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07352-dee9-4b60-8397-06d9a75ecd5d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.674152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1200/2390] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 08:50:06.677979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.678274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.678559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.698218 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:06.699522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:06.745144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] The token cache is being invalidate because project 1db518a7c0264906a196bbc05a84a08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:06.745770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:06.748155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-159af659-6a9e-4d0a-b40a-3bce4d48c65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:06.750169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1191/2391] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:06 2022] DELETE /identity/v3/projects/1db518a7c0264906a196bbc05a84a08c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:06.758538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9b22-5c05-4b23-ab28-312496fa7a9d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.758883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9b22-5c05-4b23-ab28-312496fa7a9d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.759165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9b22-5c05-4b23-ab28-312496fa7a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.778909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f3ec9b22-5c05-4b23-ab28-312496fa7a9d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:06.780149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f3ec9b22-5c05-4b23-ab28-312496fa7a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:06.791386 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1201/2392] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:06.802869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:06.815773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:06.877666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:06.891905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a93f-80fb-416b-926c-3f67c40ff7b2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:06.895808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1192/2393] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:06.896750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:06.897437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.897810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.898107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.904770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab15f4-e549-4433-b0ef-7ce1a69e3dd1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.905114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab15f4-e549-4433-b0ef-7ce1a69e3dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.905345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab15f4-e549-4433-b0ef-7ce1a69e3dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.911477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:06.913434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:06.926887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f6ab15f4-e549-4433-b0ef-7ce1a69e3dd1 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:06.927550 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1202/2394] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:50:06.935382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f6ab15f4-e549-4433-b0ef-7ce1a69e3dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:06.952615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1193/2395] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:06.958855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:06.977928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742d3a6-0b3a-4c52-98cb-75879aefae42 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:06.987385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:06.988874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:06.989492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:06.990127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:06.991672 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:50:06.992440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:06.996222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:07.017811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1203/2396] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:50:07.019310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab15f4-e549-4433-b0ef-7ce1a69e3dd1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:07.034638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab15f4-e549-4433-b0ef-7ce1a69e3dd1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:07.040895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:07.041618 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:07.041939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:07.042223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:07.042937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:07.045185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:07.212396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1194/2397] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:50:07 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:07.218123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:07.229789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9ce0-e130-48c9-a9ff-e5f2cb42e7e5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:07.305276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:07.306395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:07.306862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:07.307322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:07.309295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:07.311602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:07.431822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1204/2398] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:50:07 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:07.435969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:07.447376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e19946-8ff3-4205-af7d-bd0e1d042556 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:07.457256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:07.457989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:07.458263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:07.458540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:07.459287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:07.461541 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:07.473341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1195/2399] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:07.479064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:07.493178 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51bd4c-02c7-4462-b4d3-22377848cbdc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:07.498988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ad84b-6254-4941-b7a8-3c9254fd7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:07.499739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad84b-6254-4941-b7a8-3c9254fd7e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:07.502344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad84b-6254-4941-b7a8-3c9254fd7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:07.502344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad84b-6254-4941-b7a8-3c9254fd7e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:07.502344 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ad84b-6254-4941-b7a8-3c9254fd7e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:07.503117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ad84b-6254-4941-b7a8-3c9254fd7e6b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:07.520104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1205/2400] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:07.523907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:07.536779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08106-92dd-4cc1-bc49-d8bc136a2aa0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:07.542717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:07.543615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:07.543932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:07.544210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] PATH_INFO: `/v3/projects/9959e65c264f41b0b05158ae006573f2/users/5a5fc8ac6d7b4661834bf2cbcc2a45ee/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:07.565894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9959e65c264f41b0b05158ae006573f2, user_id=5a5fc8ac6d7b4661834bf2cbcc2a45ee, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:07.568659 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:07.667012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1196/2401] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:07 2022] PUT /identity/v3/projects/9959e65c264f41b0b05158ae006573f2/users/5a5fc8ac6d7b4661834bf2cbcc2a45ee/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:07.678546 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0999-69eb-4c66-b926-e1ccac572f3e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:07.678845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0999-69eb-4c66-b926-e1ccac572f3e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:07.679125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0999-69eb-4c66-b926-e1ccac572f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:07.713942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-edee0999-69eb-4c66-b926-e1ccac572f3e None None] MFA Rules not processed for user `5a5fc8ac6d7b4661834bf2cbcc2a45ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:07.715335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-edee0999-69eb-4c66-b926-e1ccac572f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:07.791859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1206/2402] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:07.805083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:07.807287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:07.870086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:07.887528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1f41e-7d9f-411f-bb3c-cf920e194b01 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:07.891468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a5373-cf45-4ba0-8e84-fa8fb34e707c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:07.892148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5373-cf45-4ba0-8e84-fa8fb34e707c service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:07.892434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5373-cf45-4ba0-8e84-fa8fb34e707c service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:07.892714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5373-cf45-4ba0-8e84-fa8fb34e707c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:07.903185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a5373-cf45-4ba0-8e84-fa8fb34e707c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:07.904691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a5373-cf45-4ba0-8e84-fa8fb34e707c service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:07.922191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1197/2403] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:50:07.955017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee0999-69eb-4c66-b926-e1ccac572f3e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:08.012854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:08.035995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee0999-69eb-4c66-b926-e1ccac572f3e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:08.042564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:08.043664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:08.044248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:08.044536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] PATH_INFO: `/v3/users/5a5fc8ac6d7b4661834bf2cbcc2a45ee` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:08.046124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5fc8ac6d7b4661834bf2cbcc2a45ee)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:08.048095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:08.308941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5fc8ac6d7b4661834bf2cbcc2a45ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:08.309658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5fc8ac6d7b4661834bf2cbcc2a45ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:08.326641 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5fc8ac6d7b4661834bf2cbcc2a45ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:08.342722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5fc8ac6d7b4661834bf2cbcc2a45ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:08.344742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5fc8ac6d7b4661834bf2cbcc2a45ee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:08.494130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1207/2404] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:07 2022] DELETE /identity/v3/users/5a5fc8ac6d7b4661834bf2cbcc2a45ee => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:08.499784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:08.500366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:08.500786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:08.536146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:08.538421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:08.654856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1198/2405] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:08.666689 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:08.668180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:08.746126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090fe97-b64e-4919-98dd-7e28da5ba278 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:08.750349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e051b68-3037-4680-a3bc-297576d9fc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:08.757793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e051b68-3037-4680-a3bc-297576d9fc82 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:08.757793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e051b68-3037-4680-a3bc-297576d9fc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:08.757793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e051b68-3037-4680-a3bc-297576d9fc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:08.763049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e051b68-3037-4680-a3bc-297576d9fc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:08.765254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e051b68-3037-4680-a3bc-297576d9fc82 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:08.780233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1208/2406] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:09.271633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:09.273226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:09.287094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c505-cd16-481b-82a9-f1030f31dbb9 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:09.293590 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:09.296082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:09.296082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:09.296651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] PATH_INFO: `/v3/projects/9959e65c264f41b0b05158ae006573f2` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:09.298193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9959e65c264f41b0b05158ae006573f2)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:09.300283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:09.428697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9959e65c264f41b0b05158ae006573f2', 'request_id': 'req-a9f660c8-1cab-4dff-b926-faa0a8db4205'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:09.436637 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9959e65c264f41b0b05158ae006573f2', 'request_id': 'req-a9f660c8-1cab-4dff-b926-faa0a8db4205'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:09.448956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9959e65c264f41b0b05158ae006573f2', 'request_id': 'req-a9f660c8-1cab-4dff-b926-faa0a8db4205'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:09.591217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] The token cache is being invalidate because project 9959e65c264f41b0b05158ae006573f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:09.591918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:09.592264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a9f660c8-1cab-4dff-b926-faa0a8db4205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:09.593994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1199/2407] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:09 2022] DELETE /identity/v3/projects/9959e65c264f41b0b05158ae006573f2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:09.599407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59186-d20d-4dd9-98fd-b79fbdedea7b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:09.600112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59186-d20d-4dd9-98fd-b79fbdedea7b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:09.600112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59186-d20d-4dd9-98fd-b79fbdedea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:09.619388 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fdd59186-d20d-4dd9-98fd-b79fbdedea7b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:09.620607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fdd59186-d20d-4dd9-98fd-b79fbdedea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:09.706139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1209/2408] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:09.709782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412f09-bb56-432d-afc0-90dad1a51d27 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:09.710077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412f09-bb56-432d-afc0-90dad1a51d27 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:09.710528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412f09-bb56-432d-afc0-90dad1a51d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:09.734380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-99412f09-bb56-432d-afc0-90dad1a51d27 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:09.735987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-99412f09-bb56-432d-afc0-90dad1a51d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:09.746225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1200/2409] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:09.751042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd59186-d20d-4dd9-98fd-b79fbdedea7b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:09.763914 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:09.769058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd59186-d20d-4dd9-98fd-b79fbdedea7b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:09.775042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:09.776006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:09.776424 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:09.776803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:09.777788 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:50:09.778140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:09.779961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:09.799002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1210/2410] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:50:09.801330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412f09-bb56-432d-afc0-90dad1a51d27 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:09.822005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412f09-bb56-432d-afc0-90dad1a51d27 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:09.829202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:09.829873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:09.830149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:09.830414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:09.831128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:09.833200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:09.955265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1201/2411] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:50:09 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:09.961917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:09.973661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ad361-f24f-4c0f-add0-3ada3a2585fd admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:10.056146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:10.056890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:10.057211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:10.057543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:10.058721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:10.063316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:10.161480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1211/2412] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:50:09 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:10.162774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:10.175967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2b915-9edf-4fa4-ba71-10a4f74686e8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:10.182641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:10.183703 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:10.183998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:10.184274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:10.185047 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:10.186924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:10.205021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1202/2413] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:10.207061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:10.225617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f2e7d-e86f-47fa-8115-7e579b19badc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:10.234794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d6db2-96b5-41e9-9d5f-3250ddbfa9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:10.235549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6db2-96b5-41e9-9d5f-3250ddbfa9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:10.235839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6db2-96b5-41e9-9d5f-3250ddbfa9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:10.236131 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6db2-96b5-41e9-9d5f-3250ddbfa9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:10.236999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d6db2-96b5-41e9-9d5f-3250ddbfa9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:10.238873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d6db2-96b5-41e9-9d5f-3250ddbfa9bf admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:10.253333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1212/2414] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:10.258472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:10.269503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2420fa-9373-43df-a4d2-52e9b86acb8b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:10.274849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:10.275761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:10.276066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:10.276660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] PATH_INFO: `/v3/projects/3fe5627428c744bcba530ecd05f5ffd2/users/46152cea7a31492593e95680ccfe3d7a/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:10.302379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe5627428c744bcba530ecd05f5ffd2, user_id=46152cea7a31492593e95680ccfe3d7a, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:10.305861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:10.427144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1203/2415] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:10 2022] PUT /identity/v3/projects/3fe5627428c744bcba530ecd05f5ffd2/users/46152cea7a31492593e95680ccfe3d7a/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:10.500830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd8ee-bc16-4ed3-aa52-a85e07271b4f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:10.501111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd8ee-bc16-4ed3-aa52-a85e07271b4f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:10.501387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd8ee-bc16-4ed3-aa52-a85e07271b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:10.533638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3adfd8ee-bc16-4ed3-aa52-a85e07271b4f None None] MFA Rules not processed for user `46152cea7a31492593e95680ccfe3d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:10.534952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3adfd8ee-bc16-4ed3-aa52-a85e07271b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:10.625872 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1213/2416] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:10.640227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:10.642522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:10.648919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:10.722901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874757ef-f310-4d66-bda4-24fc8bba9410 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:10.727801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:10.734506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:10.734795 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:10.735075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:10.749667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:10.751224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:10.761971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1204/2417] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:10.820319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:10.820825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:10.821383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:10.844566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:10.844566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:10.930769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1214/2418] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:10.944162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:10.945626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:11.059324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac906ee1-3bf7-4896-9a66-f621d30be957 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:11.080180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:11.080855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:11.082919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:11.082919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:11.090677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:11.092401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:11.103300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1205/2419] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:50:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:50:11.689525 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:11.691639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:11.700948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:11.787880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d78bd2-562a-4a1a-a631-d735c22f0555 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:11.794595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:11.795639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:11.795977 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:11.796248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] PATH_INFO: `/v3/users/d10fb9ba437c423e883c55f031c503a3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:11.797528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10fb9ba437c423e883c55f031c503a3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:11.799732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:12.050067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10fb9ba437c423e883c55f031c503a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.050805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10fb9ba437c423e883c55f031c503a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.064447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10fb9ba437c423e883c55f031c503a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.071786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10fb9ba437c423e883c55f031c503a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.072533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10fb9ba437c423e883c55f031c503a3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.180605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1215/2420] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:11 2022] DELETE /identity/v3/users/d10fb9ba437c423e883c55f031c503a3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:12.495739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:12.508504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fb0d-367c-449e-be5b-b51192eacc96 service swift] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:12.602347 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:12.603466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:12.603752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:12.604026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] PATH_INFO: `/v3/projects/3227e9a77104498d829f72264538706e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:12.605239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3227e9a77104498d829f72264538706e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:12.607341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:12.727934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:12.740615 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3227e9a77104498d829f72264538706e', 'request_id': 'req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.746570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3227e9a77104498d829f72264538706e', 'request_id': 'req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.753083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3227e9a77104498d829f72264538706e', 'request_id': 'req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.871185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] The token cache is being invalidate because project 3227e9a77104498d829f72264538706e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:12.871764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.872727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:12.874708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1206/2421] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:12 2022] DELETE /identity/v3/projects/3227e9a77104498d829f72264538706e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:12.878921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:12.881042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:12.895748 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994261-cc90-4a99-be43-bbde0861f2b5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:12.968910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:12.969837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:12.970116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:12.970393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] PATH_INFO: `/v3/users/e71454185a764dd892da7a6d80820e41` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:12.971679 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71454185a764dd892da7a6d80820e41)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:12.973652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:13.071522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:13.183227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71454185a764dd892da7a6d80820e41'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.184508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71454185a764dd892da7a6d80820e41'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.216686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71454185a764dd892da7a6d80820e41'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.227990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71454185a764dd892da7a6d80820e41'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.229184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-08dc9348-90ef-47ad-800b-d0d501b66c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71454185a764dd892da7a6d80820e41'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.306900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1216/2422] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:12 2022] DELETE /identity/v3/users/e71454185a764dd892da7a6d80820e41 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:13.593587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:13.595762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:13.612272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc98d7-f42b-442e-97f2-2c96eb0e99a3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:13.678342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:13.679246 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:13.679707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:13.680066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] PATH_INFO: `/v3/projects/70ac7052e3bc427499db954129156632` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:13.681314 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ac7052e3bc427499db954129156632)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:13.683289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:13.833803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ac7052e3bc427499db954129156632', 'request_id': 'req-ba38a357-a22a-4613-9879-e31701373671'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.850557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ac7052e3bc427499db954129156632', 'request_id': 'req-ba38a357-a22a-4613-9879-e31701373671'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.868796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ac7052e3bc427499db954129156632', 'request_id': 'req-ba38a357-a22a-4613-9879-e31701373671'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.968782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] The token cache is being invalidate because project 70ac7052e3bc427499db954129156632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:13.969086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.969860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ba38a357-a22a-4613-9879-e31701373671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:13.971551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1207/2423] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:13 2022] DELETE /identity/v3/projects/70ac7052e3bc427499db954129156632 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:13.976589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9eac0-0f15-428b-8572-016b76c21397 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:13.977210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9eac0-0f15-428b-8572-016b76c21397 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:13.977327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9eac0-0f15-428b-8572-016b76c21397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:13.999916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-73a9eac0-0f15-428b-8572-016b76c21397 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:14.001120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-73a9eac0-0f15-428b-8572-016b76c21397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:14.077116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1217/2424] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:14.086554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4c36-ea17-45c3-bbcf-e55ba617e9d4 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.086803 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4c36-ea17-45c3-bbcf-e55ba617e9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.087087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4c36-ea17-45c3-bbcf-e55ba617e9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.109193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2b2d4c36-ea17-45c3-bbcf-e55ba617e9d4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:14.111627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2b2d4c36-ea17-45c3-bbcf-e55ba617e9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:14.122286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1208/2425] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:14.126818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9eac0-0f15-428b-8572-016b76c21397 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:14.138009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9eac0-0f15-428b-8572-016b76c21397 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:14.142945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:14.143681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.144059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.144406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.145087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:50:14.145660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:14.147080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:14.161383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1218/2426] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:50:14.167178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d4c36-ea17-45c3-bbcf-e55ba617e9d4 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:14.177514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d4c36-ea17-45c3-bbcf-e55ba617e9d4 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:14.183614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:14.184418 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.184821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.185225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.186087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:14.188167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:14.317225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1209/2427] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:50:14 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:14.322507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:14.335135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953781-4957-47a0-9c85-9ac39bbf93b9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:14.416356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:14.417054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.417451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.417710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.418449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:14.420382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:14.521588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1219/2428] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:50:14 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:14.534944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:14.547989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a56d1-dc72-4fde-9145-d0a0327a8a57 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:14.553365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:14.554110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.554459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.554849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.555606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:14.557241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:14.570394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1210/2429] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:50:14.581042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:14.596942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e297618-3516-410e-9d9c-f7288f3c5f50 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:14.603105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef4d7a-0fcd-4879-9cff-f8dc5698c344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:14.608112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4d7a-0fcd-4879-9cff-f8dc5698c344 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.608112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4d7a-0fcd-4879-9cff-f8dc5698c344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.608112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4d7a-0fcd-4879-9cff-f8dc5698c344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.608112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef4d7a-0fcd-4879-9cff-f8dc5698c344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:14.608112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef4d7a-0fcd-4879-9cff-f8dc5698c344 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:14.618435 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1220/2430] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:14.624390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:14.636178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca82e2-6a57-4de4-bff8-f01829494ebe admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:14.645260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:14.646414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.646832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.647270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] PATH_INFO: `/v3/projects/40a4290e2e344d608c74d4f0f902c0e2/users/dbedee92faea4625893ecb9bf3681561/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.668998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:14.672439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a4290e2e344d608c74d4f0f902c0e2, user_id=dbedee92faea4625893ecb9bf3681561, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:14.675812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:14.778862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1211/2431] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:14 2022] PUT /identity/v3/projects/40a4290e2e344d608c74d4f0f902c0e2/users/dbedee92faea4625893ecb9bf3681561/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:50:14.789876 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dbc76-8ba7-4fff-b0ad-3fe68fc4c8ef None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:14.790175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dbc76-8ba7-4fff-b0ad-3fe68fc4c8ef None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:14.790680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dbc76-8ba7-4fff-b0ad-3fe68fc4c8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:14.811266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:14.822863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-095dbc76-8ba7-4fff-b0ad-3fe68fc4c8ef None None] MFA Rules not processed for user `dbedee92faea4625893ecb9bf3681561`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:14.824092 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-095dbc76-8ba7-4fff-b0ad-3fe68fc4c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:14.946000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1221/2432] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:14.963796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:14.969029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:15.052840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcd2b4-1bbe-44d4-a1bd-f6c3d0ad5905 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:15.057176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f981c4d-a3e9-40d5-9ebb-5b4d3d55f0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:15.057895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f981c4d-a3e9-40d5-9ebb-5b4d3d55f0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:15.058180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f981c4d-a3e9-40d5-9ebb-5b4d3d55f0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:15.058453 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f981c4d-a3e9-40d5-9ebb-5b4d3d55f0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:15.068076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f981c4d-a3e9-40d5-9ebb-5b4d3d55f0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:15.069578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f981c4d-a3e9-40d5-9ebb-5b4d3d55f0d0 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:15.092354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1212/2433] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:50:24.718053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dbc76-8ba7-4fff-b0ad-3fe68fc4c8ef None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:24.787786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dbc76-8ba7-4fff-b0ad-3fe68fc4c8ef None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:24.793948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:24.794852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:24.795295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:24.795470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] PATH_INFO: `/v3/users/dbedee92faea4625893ecb9bf3681561` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:24.796767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbedee92faea4625893ecb9bf3681561)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:24.798826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:25.042560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbedee92faea4625893ecb9bf3681561'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:25.043258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbedee92faea4625893ecb9bf3681561'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:25.057561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbedee92faea4625893ecb9bf3681561'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:25.065970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbedee92faea4625893ecb9bf3681561'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:25.066736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbedee92faea4625893ecb9bf3681561'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:25.076968 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:25.163028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1222/2434] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:24 2022] DELETE /identity/v3/users/dbedee92faea4625893ecb9bf3681561 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:25.168486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:25.168897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:25.169281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:25.189317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:25.190813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:25.261845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1213/2435] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:25.271842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:25.273306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:25.295600 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:25.335869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aad5dd-c019-4186-884c-80c59b597f4a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:25.343791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f357d-28ee-4ebd-8719-05676f6c75e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:25.344622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f357d-28ee-4ebd-8719-05676f6c75e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:25.345005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f357d-28ee-4ebd-8719-05676f6c75e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:25.345405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f357d-28ee-4ebd-8719-05676f6c75e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:25.356632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f357d-28ee-4ebd-8719-05676f6c75e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:25.358167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f357d-28ee-4ebd-8719-05676f6c75e2 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:25.368923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1223/2436] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:25.872491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:25.874935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:25.887016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0d4bc-b757-45d2-a50c-5ab0d049e705 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:25.891970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:25.892870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:25.893144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:25.893423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] PATH_INFO: `/v3/projects/40a4290e2e344d608c74d4f0f902c0e2` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:25.894752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a4290e2e344d608c74d4f0f902c0e2)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:25.896740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:26.045556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a4290e2e344d608c74d4f0f902c0e2', 'request_id': 'req-18fa0da2-e336-4940-a37b-b039afef404e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:26.051694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a4290e2e344d608c74d4f0f902c0e2', 'request_id': 'req-18fa0da2-e336-4940-a37b-b039afef404e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:26.059445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a4290e2e344d608c74d4f0f902c0e2', 'request_id': 'req-18fa0da2-e336-4940-a37b-b039afef404e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:26.160984 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] The token cache is being invalidate because project 40a4290e2e344d608c74d4f0f902c0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:26.161577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:26.162020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-18fa0da2-e336-4940-a37b-b039afef404e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:26.163826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1214/2437] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:25 2022] DELETE /identity/v3/projects/40a4290e2e344d608c74d4f0f902c0e2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:26.169818 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e33d7-7bf0-44b8-b309-ebfabc92aae3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.170652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e33d7-7bf0-44b8-b309-ebfabc92aae3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.170652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e33d7-7bf0-44b8-b309-ebfabc92aae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.193962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ea2e33d7-7bf0-44b8-b309-ebfabc92aae3 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:26.195210 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ea2e33d7-7bf0-44b8-b309-ebfabc92aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:26.261562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1224/2438] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:26.329841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ef2f-bc0f-4bc3-961a-3874f8442106 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.330121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ef2f-bc0f-4bc3-961a-3874f8442106 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.330394 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ef2f-bc0f-4bc3-961a-3874f8442106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.349355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2869ef2f-bc0f-4bc3-961a-3874f8442106 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:26.350611 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2869ef2f-bc0f-4bc3-961a-3874f8442106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:26.359640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1215/2439] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:26.364194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e33d7-7bf0-44b8-b309-ebfabc92aae3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:26.374441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e33d7-7bf0-44b8-b309-ebfabc92aae3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:26.379380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:26.380052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.380337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.380614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.381342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:50:26.381649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:26.383393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:26.396125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1225/2440] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:50:26.401203 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869ef2f-bc0f-4bc3-961a-3874f8442106 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:26.410640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869ef2f-bc0f-4bc3-961a-3874f8442106 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:26.420716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:26.421410 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.421695 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.421983 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.422689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:26.424709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:26.523694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1216/2441] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:50:26 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:26.529090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:26.541711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6d28f-4942-4c95-b4fb-42b801382e66 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:26.614667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:26.615357 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.615732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.616067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.616910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:26.619816 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:26.733262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1226/2442] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:50:26 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:50:26.738651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:26.751445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb3328-e34b-44a0-9288-0b34664eeaa5 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:26.757471 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:26.758274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.759129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.759409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.760159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:26.761877 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:26.774038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1217/2443] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:26.782626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:26.794494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b75b-5cb0-4e41-badd-09489bdf7d74 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:26.799223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b9a81-4fb9-45f5-858f-f979f80e246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:26.800302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b9a81-4fb9-45f5-858f-f979f80e246f admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.800302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b9a81-4fb9-45f5-858f-f979f80e246f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.800590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b9a81-4fb9-45f5-858f-f979f80e246f admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.801396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b9a81-4fb9-45f5-858f-f979f80e246f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:26.802957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b9a81-4fb9-45f5-858f-f979f80e246f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:26.816978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1227/2444] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:26.829587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:26.841834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a61a-a2a3-431f-a357-7afebcae76a6 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:26.847185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:26.848099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.848386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.848663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] PATH_INFO: `/v3/projects/50a2c946d7bb4ea79b3756f80eab7b9a/users/15bdb7478adb426688c3ff592b3008e5/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.864392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a2c946d7bb4ea79b3756f80eab7b9a, user_id=15bdb7478adb426688c3ff592b3008e5, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:26.867165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:26.952551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1218/2445] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:26 2022] PUT /identity/v3/projects/50a2c946d7bb4ea79b3756f80eab7b9a/users/15bdb7478adb426688c3ff592b3008e5/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:26.963716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a888f4-34aa-45ef-a115-3feae4da295d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:26.963919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a888f4-34aa-45ef-a115-3feae4da295d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:26.964188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a888f4-34aa-45ef-a115-3feae4da295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:26.995939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-02a888f4-34aa-45ef-a115-3feae4da295d None None] MFA Rules not processed for user `15bdb7478adb426688c3ff592b3008e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:26.997262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-02a888f4-34aa-45ef-a115-3feae4da295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:27.011519 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:27.066159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1228/2446] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:27.070675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:27.093994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:27.139816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7086e3-4e4e-4089-90b0-af5156f999cd admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:27.144855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:27.145542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:27.145858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:27.146154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:27.147014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:27.148992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:27.261616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1219/2447] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:50:27 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:27.266582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a888f4-34aa-45ef-a115-3feae4da295d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:27.278577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a888f4-34aa-45ef-a115-3feae4da295d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:27.343956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:27.344649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:27.344934 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:27.345211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:27.345938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:27.347886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:27.419874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1229/2448] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:50:27 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:27.424175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:27.439042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a7c59-2df6-4b84-871c-465c1a424156 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:27.442586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:27.443281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:27.443566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:27.443851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:27.444601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:27.446478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:27.463101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1220/2449] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:27.469591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:27.482166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879258-0cdc-4d5c-b650-9056d29019e5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:27.487238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574381c-5099-4ab3-998f-137f55e5c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:27.487973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574381c-5099-4ab3-998f-137f55e5c0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:27.488262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574381c-5099-4ab3-998f-137f55e5c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:27.488566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574381c-5099-4ab3-998f-137f55e5c0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:27.489337 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574381c-5099-4ab3-998f-137f55e5c0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:27.491037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574381c-5099-4ab3-998f-137f55e5c0f2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:27.504003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1230/2450] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:27.508468 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:27.519180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1652f7-8dfb-474d-89b5-d9953da4a720 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:27.524123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:27.525207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:27.525498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:27.525863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] PATH_INFO: `/v3/projects/b426a8cda1174da1aa5c877de3953638/users/49c65f7ee8e74f9bad7a91ac650598b6/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:27.546522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b426a8cda1174da1aa5c877de3953638, user_id=49c65f7ee8e74f9bad7a91ac650598b6, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:27.551603 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:27.615505 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1221/2451] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:27 2022] PUT /identity/v3/projects/b426a8cda1174da1aa5c877de3953638/users/49c65f7ee8e74f9bad7a91ac650598b6/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:27.627988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa333a-1f18-4374-9703-bb43ba6f2a0b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:27.628300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa333a-1f18-4374-9703-bb43ba6f2a0b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:27.628648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa333a-1f18-4374-9703-bb43ba6f2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:27.656761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-31aa333a-1f18-4374-9703-bb43ba6f2a0b None None] MFA Rules not processed for user `49c65f7ee8e74f9bad7a91ac650598b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:27.658030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-31aa333a-1f18-4374-9703-bb43ba6f2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:27.743007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1231/2452] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:27.747700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:27.814847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c5d3c-324e-487c-9231-60e913f9e4a6 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:27.819797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:27.820481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:27.821161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:27.821161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:27.821854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:27.823859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:27.917393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1222/2453] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:50:27 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:27.922448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa333a-1f18-4374-9703-bb43ba6f2a0b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:27.942558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa333a-1f18-4374-9703-bb43ba6f2a0b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:27.980655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:28.028736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:28.029654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.030124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.030536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.031319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:28.033395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:28.143566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1232/2454] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:50:27 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:28.147967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:28.160192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f190ac-daf7-42ac-bf2d-d2908bc549e5 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:28.165122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:28.165834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.166122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.166406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.167150 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:28.168779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:28.180355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1223/2455] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:28.186557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:28.198770 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f5b46-d116-442e-bc23-9fc362ff604d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:28.204166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:28.205109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.205389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.210275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] PATH_INFO: `/v3/projects/2d728e98feeb45c3a6758e5d23b60fc4/users/f2c81c7532a74e16a687f1c0226b2fe3/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.227582 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d728e98feeb45c3a6758e5d23b60fc4, user_id=f2c81c7532a74e16a687f1c0226b2fe3, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:28.232792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:28.334688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1233/2456] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:28 2022] PUT /identity/v3/projects/2d728e98feeb45c3a6758e5d23b60fc4/users/f2c81c7532a74e16a687f1c0226b2fe3/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:28.340584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:28.355535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffe9b5-2115-4eef-b38e-c4a522c0e3af admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:28.406858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:28.423953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a1c1c-54c7-4775-a149-1b95727b9e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:28.424633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1c1c-54c7-4775-a149-1b95727b9e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.424915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1c1c-54c7-4775-a149-1b95727b9e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.425190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1c1c-54c7-4775-a149-1b95727b9e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.425965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a1c1c-54c7-4775-a149-1b95727b9e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:28.427587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a1c1c-54c7-4775-a149-1b95727b9e20 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:28.439566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1224/2457] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:28.444456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:28.456497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a0f6-4130-40d4-b7bf-7eec10ecf8cf admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:28.462450 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:28.463565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.463847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.464124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] PATH_INFO: `/v3/projects/2d728e98feeb45c3a6758e5d23b60fc4/users/f2c81c7532a74e16a687f1c0226b2fe3/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.466224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d728e98feeb45c3a6758e5d23b60fc4, user_id=f2c81c7532a74e16a687f1c0226b2fe3, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:28.468920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:28.481342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1234/2458] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:28 2022] PUT /identity/v3/projects/2d728e98feeb45c3a6758e5d23b60fc4/users/f2c81c7532a74e16a687f1c0226b2fe3/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:28.491828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.492461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.493349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.523955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:28.523955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:28.533285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] MFA Rules not processed for user `f2c81c7532a74e16a687f1c0226b2fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:28.535158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:28.608464 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ac32-756d-4218-9104-e3a0ef782418 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:28.614804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:28.615893 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.616283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.616686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] PATH_INFO: `/v3/users/46152cea7a31492593e95680ccfe3d7a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.618420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46152cea7a31492593e95680ccfe3d7a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:28.621200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:28.653607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1225/2459] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:28.668475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:28.670242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:28.741183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e8f3-137a-43bf-81c3-2fdb22bb15e1 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:28.745745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5334-3638-48b8-a1cc-66c1d17d0cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:28.746456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5334-3638-48b8-a1cc-66c1d17d0cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.746745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5334-3638-48b8-a1cc-66c1d17d0cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.747029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5334-3638-48b8-a1cc-66c1d17d0cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.819777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5334-3638-48b8-a1cc-66c1d17d0cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:28.821943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5334-3638-48b8-a1cc-66c1d17d0cc6 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:28.832626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1226/2460] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:50:28.847329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46152cea7a31492593e95680ccfe3d7a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:28.848313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46152cea7a31492593e95680ccfe3d7a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:28.863668 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46152cea7a31492593e95680ccfe3d7a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:28.873541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46152cea7a31492593e95680ccfe3d7a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:28.874327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46152cea7a31492593e95680ccfe3d7a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:28.879794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:28.972516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1235/2461] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:28 2022] DELETE /identity/v3/users/46152cea7a31492593e95680ccfe3d7a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:50:28.978889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:28.978889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:28.979297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:28.999507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:29.000714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:29.014946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:29.078700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1227/2462] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:29.093576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:29.095259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:29.163385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193311b6-4553-4084-a1b8-7f4c5b6735b2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:29.169052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:29.169783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:29.170129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:29.170408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:29.181095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:29.182766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:29.197469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1236/2463] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:29.677079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:29.678612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:29.691486 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ad37f-f775-4f02-9047-ed290b993f1b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:29.696989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:29.698160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:29.698448 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:29.698728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] PATH_INFO: `/v3/projects/3fe5627428c744bcba530ecd05f5ffd2` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:29.700001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe5627428c744bcba530ecd05f5ffd2)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:29.702306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:29.814027 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe5627428c744bcba530ecd05f5ffd2', 'request_id': 'req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:29.819735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe5627428c744bcba530ecd05f5ffd2', 'request_id': 'req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:29.827309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe5627428c744bcba530ecd05f5ffd2', 'request_id': 'req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:29.932934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] The token cache is being invalidate because project 3fe5627428c744bcba530ecd05f5ffd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:29.932934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:29.932934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:29.932934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1228/2464] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:29 2022] DELETE /identity/v3/projects/3fe5627428c744bcba530ecd05f5ffd2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:30.933171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:30.936294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:30.991970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f640-7e08-4dbc-b4f8-4fd4bf6e4a6b service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:31.041815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:31.042473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:31.042764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:31.043046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:31.044864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:31.103924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:31.105282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:31.114398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1237/2465] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:32.545206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:32.546738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:32.560311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fde5b-c9c2-434f-9ae3-afaca8dbf33d admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:32.564091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa72d8e-0231-40d8-bbd5-bdfb4ba6b380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:32.564731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa72d8e-0231-40d8-bbd5-bdfb4ba6b380 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:32.565015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa72d8e-0231-40d8-bbd5-bdfb4ba6b380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:32.565291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa72d8e-0231-40d8-bbd5-bdfb4ba6b380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:32.567122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5aa72d8e-0231-40d8-bbd5-bdfb4ba6b380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:32.631800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa72d8e-0231-40d8-bbd5-bdfb4ba6b380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:32.633436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa72d8e-0231-40d8-bbd5-bdfb4ba6b380 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:32.644093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1229/2466] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:37.521790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:37.523325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:37.534495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:37.592004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788af83-706d-4d5c-b771-d1bd92984df2 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:37.596623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:37.597498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:37.597819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:37.598094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] PATH_INFO: `/v3/users/15bdb7478adb426688c3ff592b3008e5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:37.599297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15bdb7478adb426688c3ff592b3008e5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:37.601292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:37.808766 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15bdb7478adb426688c3ff592b3008e5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:37.810049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15bdb7478adb426688c3ff592b3008e5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:37.822408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15bdb7478adb426688c3ff592b3008e5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:37.829534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15bdb7478adb426688c3ff592b3008e5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:37.830297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15bdb7478adb426688c3ff592b3008e5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:37.897191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1238/2467] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:37 2022] DELETE /identity/v3/users/15bdb7478adb426688c3ff592b3008e5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:37.902151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:37.902628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:37.902724 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:37.921447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:37.922856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:37.957979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:37.985282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1230/2468] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:37.995986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:38.000465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:38.056542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ae181-30b2-4286-8c2f-bd28d55beee6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:38.060794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18724fbd-9898-42c1-a8b4-1bccb45031ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:38.061456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724fbd-9898-42c1-a8b4-1bccb45031ae service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:38.061773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724fbd-9898-42c1-a8b4-1bccb45031ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:38.062055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724fbd-9898-42c1-a8b4-1bccb45031ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:38.072928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18724fbd-9898-42c1-a8b4-1bccb45031ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:38.074595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18724fbd-9898-42c1-a8b4-1bccb45031ae service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:38.085858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1239/2469] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:38.477176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:38.478754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:38.493345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b17170-652b-4003-bf51-dd2accdba135 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:38.501260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:38.502766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:38.503061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:38.503367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] PATH_INFO: `/v3/projects/50a2c946d7bb4ea79b3756f80eab7b9a` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:38.504607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a2c946d7bb4ea79b3756f80eab7b9a)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:38.506604 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:38.638571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:38.639109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:38.639109 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:38.649479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a2c946d7bb4ea79b3756f80eab7b9a', 'request_id': 'req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:38.655359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a2c946d7bb4ea79b3756f80eab7b9a', 'request_id': 'req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:38.658983 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:38.660593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:38.661548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a2c946d7bb4ea79b3756f80eab7b9a', 'request_id': 'req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:38.688857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:38.718071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1240/2470] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 08:50:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:50:38.738684 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] The token cache is being invalidate because project 50a2c946d7bb4ea79b3756f80eab7b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:38.739491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:38.740257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:38.741433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:38.741997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1231/2471] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:38 2022] DELETE /identity/v3/projects/50a2c946d7bb4ea79b3756f80eab7b9a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:38.743028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:38.746055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:38.748070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:38.826316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d45bc1-ce0e-4f18-a3f4-41449c632aeb admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:38.827683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac7c90-59f2-4000-ac4b-e060f9fdd902 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:38.832316 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:38.833384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:38.833691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:38.834082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:38.834221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:38.834368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:38.834531 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] PATH_INFO: `/v3/users/49c65f7ee8e74f9bad7a91ac650598b6` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:38.834682 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:38.836622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:38.837253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c65f7ee8e74f9bad7a91ac650598b6)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:38.841382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:38.850409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:38.852518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:38.872997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1241/2472] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:50:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:50:39.134050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c65f7ee8e74f9bad7a91ac650598b6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:39.134762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c65f7ee8e74f9bad7a91ac650598b6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:39.145575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:39.146860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c65f7ee8e74f9bad7a91ac650598b6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:39.154414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c65f7ee8e74f9bad7a91ac650598b6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:39.155103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c65f7ee8e74f9bad7a91ac650598b6'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:39.282805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1232/2473] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:38 2022] DELETE /identity/v3/users/49c65f7ee8e74f9bad7a91ac650598b6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:39.795814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:39.806108 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28881b0-b67e-43c0-afa7-2794d8e5b64d service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:39.884085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:39.884957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:39.885293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:39.885563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] PATH_INFO: `/v3/projects/b426a8cda1174da1aa5c877de3953638` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:39.886927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b426a8cda1174da1aa5c877de3953638)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:39.889487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:40.051406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b426a8cda1174da1aa5c877de3953638', 'request_id': 'req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.133359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b426a8cda1174da1aa5c877de3953638', 'request_id': 'req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.140150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b426a8cda1174da1aa5c877de3953638', 'request_id': 'req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.142182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:40.152743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] The token cache is being invalidate because project b426a8cda1174da1aa5c877de3953638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:40.153908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.154701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.156538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1242/2474] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:39 2022] DELETE /identity/v3/projects/b426a8cda1174da1aa5c877de3953638 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:40.160781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:40.162293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:40.177427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce17ab-db4a-4072-ba5b-4d2f227ef460 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:40.251399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:40.252276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:40.252581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:40.252854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] PATH_INFO: `/v3/users/f2c81c7532a74e16a687f1c0226b2fe3` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:40.254120 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c81c7532a74e16a687f1c0226b2fe3)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:40.256066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:40.450874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c81c7532a74e16a687f1c0226b2fe3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.451589 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c81c7532a74e16a687f1c0226b2fe3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.464827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c81c7532a74e16a687f1c0226b2fe3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.482093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c81c7532a74e16a687f1c0226b2fe3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.482093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c3e1dcfb-8da5-4ef5-8c4b-49caff6ccf21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c81c7532a74e16a687f1c0226b2fe3'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:40.573170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1233/2475] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:50:40 2022] DELETE /identity/v3/users/f2c81c7532a74e16a687f1c0226b2fe3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:41.008958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:41.008958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:41.022451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29787b-6d2a-48f9-a88f-5cfd9aef7fac admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:41.092078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da887307-4130-4e09-a695-76888e847962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:41.095208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887307-4130-4e09-a695-76888e847962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.095208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887307-4130-4e09-a695-76888e847962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.095208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887307-4130-4e09-a695-76888e847962 admin admin] PATH_INFO: `/v3/projects/2d728e98feeb45c3a6758e5d23b60fc4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.095208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da887307-4130-4e09-a695-76888e847962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d728e98feeb45c3a6758e5d23b60fc4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:41.097028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da887307-4130-4e09-a695-76888e847962 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:41.210011 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-da887307-4130-4e09-a695-76888e847962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d728e98feeb45c3a6758e5d23b60fc4', 'request_id': 'req-da887307-4130-4e09-a695-76888e847962'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:41.274454 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-da887307-4130-4e09-a695-76888e847962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d728e98feeb45c3a6758e5d23b60fc4', 'request_id': 'req-da887307-4130-4e09-a695-76888e847962'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:41.282235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-da887307-4130-4e09-a695-76888e847962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d728e98feeb45c3a6758e5d23b60fc4', 'request_id': 'req-da887307-4130-4e09-a695-76888e847962'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:41.295490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-da887307-4130-4e09-a695-76888e847962 admin admin] The token cache is being invalidate because project 2d728e98feeb45c3a6758e5d23b60fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:50:41.296480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-da887307-4130-4e09-a695-76888e847962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:41.297311 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-da887307-4130-4e09-a695-76888e847962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:50:41.298857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1243/2476] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:50:41 2022] DELETE /identity/v3/projects/2d728e98feeb45c3a6758e5d23b60fc4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:41.305046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa332-ff76-469a-b450-57a91f98e9ad None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.305557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa332-ff76-469a-b450-57a91f98e9ad None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.305706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa332-ff76-469a-b450-57a91f98e9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.325036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-526fa332-ff76-469a-b450-57a91f98e9ad None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:41.326567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-526fa332-ff76-469a-b450-57a91f98e9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:41.385048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:41.396465 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1234/2477] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:41.405176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2650-fcce-426e-9155-2b13773eeea9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.405475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2650-fcce-426e-9155-2b13773eeea9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.405815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2650-fcce-426e-9155-2b13773eeea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.426531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9d3a2650-fcce-426e-9155-2b13773eeea9 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:41.427776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9d3a2650-fcce-426e-9155-2b13773eeea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:41.436236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1244/2478] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:41.440690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fa332-ff76-469a-b450-57a91f98e9ad None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:41.452288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fa332-ff76-469a-b450-57a91f98e9ad None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:41.457268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:41.460651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.460651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.460651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.460651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:50:41.460651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:41.461112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:41.476829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1235/2479] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:50:41.481169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2650-fcce-426e-9155-2b13773eeea9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:41.491667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2650-fcce-426e-9155-2b13773eeea9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:41.496624 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:41.497306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.497626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.497946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.498657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:41.500632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:41.614339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1245/2480] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:50:41 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:50:41.618667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:41.630068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70887eac-1a30-46be-a7e1-640abdee2486 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:41.697109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:41.697908 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.698193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.698467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.699174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:41.702390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:41.849074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1236/2481] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:50:41 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:50:41.853251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:41.865174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada742af-7958-4890-8a6b-b6e392739716 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:41.870033 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:41.870713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.870997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.871273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.872013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:41.874180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:41.886576 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1246/2482] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:41.891716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:41.901740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1b1ff-c933-46fa-8f75-0b654c40fb33 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:41.907292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c520427-8b87-484c-a281-91266e6ab61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:41.908728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520427-8b87-484c-a281-91266e6ab61b admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.909020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520427-8b87-484c-a281-91266e6ab61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.909304 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520427-8b87-484c-a281-91266e6ab61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.910084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c520427-8b87-484c-a281-91266e6ab61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:41.911768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c520427-8b87-484c-a281-91266e6ab61b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:41.923481 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1237/2483] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:50:41.927849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:41.939085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc15f-cf78-4f73-9fc6-c3f603ae46d6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:41.944372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:41.945279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:41.945593 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:41.945912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] PATH_INFO: `/v3/projects/9cf95afedeff42498e7ea78d03ff08df/users/9421ac586b614f11a47718b4eefa491b/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:41.965401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf95afedeff42498e7ea78d03ff08df, user_id=9421ac586b614f11a47718b4eefa491b, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:41.969980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:42.093430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1247/2484] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:50:41 2022] PUT /identity/v3/projects/9cf95afedeff42498e7ea78d03ff08df/users/9421ac586b614f11a47718b4eefa491b/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:50:42.098825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e340f-8094-4b47-b401-10778aefbcbe None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:42.099171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e340f-8094-4b47-b401-10778aefbcbe None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:42.099425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e340f-8094-4b47-b401-10778aefbcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:42.120801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e23e340f-8094-4b47-b401-10778aefbcbe None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:42.122094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e23e340f-8094-4b47-b401-10778aefbcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:42.185466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1238/2485] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:42.196324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:42.198322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:42.226857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:42.262091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29aeb-d002-4198-9e7d-ab0ff1335d80 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:42.266567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:42.267440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:42.267736 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:42.268016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:42.277918 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:42.280634 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:42.291230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1248/2486] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:43.895431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd3e1-82d8-4ced-a830-a10e7a05d373 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:43.895902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd3e1-82d8-4ced-a830-a10e7a05d373 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:43.896184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd3e1-82d8-4ced-a830-a10e7a05d373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:43.933892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-625fd3e1-82d8-4ced-a830-a10e7a05d373 None None] MFA Rules not processed for user `9421ac586b614f11a47718b4eefa491b`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:43.935734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-625fd3e1-82d8-4ced-a830-a10e7a05d373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:44.003033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:44.013160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1239/2487] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:44.024562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:50:44.026044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:44.095477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7df2e4-6783-442f-b663-b59cc619210f service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:50:44.099254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11548d2-3e03-47c2-8dcb-3eaa469fa034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:50:44.099917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11548d2-3e03-47c2-8dcb-3eaa469fa034 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:44.100385 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11548d2-3e03-47c2-8dcb-3eaa469fa034 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:44.100658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11548d2-3e03-47c2-8dcb-3eaa469fa034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:44.111460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11548d2-3e03-47c2-8dcb-3eaa469fa034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:50:44.112970 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11548d2-3e03-47c2-8dcb-3eaa469fa034 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:50:44.123280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1249/2488] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:50:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:50:45.955037 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:50:45.955666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:50:45.955666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:50:45.974235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] MFA Rules not processed for user `9421ac586b614f11a47718b4eefa491b`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:50:45.975479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:50:45.982740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1240/2489] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:50:54.118771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=42 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:55.968727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:06.277374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090ee2-f6b5-4d54-aca9-c88cd9b00bec None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:06.277955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090ee2-f6b5-4d54-aca9-c88cd9b00bec None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:06.277955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090ee2-f6b5-4d54-aca9-c88cd9b00bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:06.296485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e4090ee2-f6b5-4d54-aca9-c88cd9b00bec None None] MFA Rules not processed for user `c048ce9cc5484139a3c5f87b4e204809`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:51:06.297701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e4090ee2-f6b5-4d54-aca9-c88cd9b00bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:06.357247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1250/2490] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:51:13.728797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:13.733032 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:13.752380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293a1f6-6055-48c5-af0b-87f4daa710d9 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:13.756332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38aabf1-a9c2-43aa-ab35-bae6ba375f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:13.756998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aabf1-a9c2-43aa-ab35-bae6ba375f61 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:13.757280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aabf1-a9c2-43aa-ab35-bae6ba375f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:13.757569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aabf1-a9c2-43aa-ab35-bae6ba375f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:13.759411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e38aabf1-a9c2-43aa-ab35-bae6ba375f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:13.859199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38aabf1-a9c2-43aa-ab35-bae6ba375f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:13.860701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38aabf1-a9c2-43aa-ab35-bae6ba375f61 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:13.875688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1241/2491] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:51:16.349828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=25 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:16.384842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4090ee2-f6b5-4d54-aca9-c88cd9b00bec None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:16.395085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4090ee2-f6b5-4d54-aca9-c88cd9b00bec None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:16.398744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:16.399389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:16.399673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:16.399947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:16.401759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:16.415393 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:16.416931 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:16.428316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1251/2492] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:51:23.869324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=34 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:26.423295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:30.112291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894985-c621-4d4b-a9c7-96bfbf670c59 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:30.112850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894985-c621-4d4b-a9c7-96bfbf670c59 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:30.112850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894985-c621-4d4b-a9c7-96bfbf670c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:30.132472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-11894985-c621-4d4b-a9c7-96bfbf670c59 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:51:30.133765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-11894985-c621-4d4b-a9c7-96bfbf670c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:30.142557 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1242/2493] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:51:30.158188 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:30.159754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:30.174847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816619b-6f60-4900-a7a7-0a3ca30486a6 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:30.182839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:30.182839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:30.182839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:30.182839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:30.191269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:30.192884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:30.203560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1252/2494] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:51:35.802362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53974-ec77-4c96-a285-afbb40a4d55d None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:35.805784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53974-ec77-4c96-a285-afbb40a4d55d None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:35.805784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53974-ec77-4c96-a285-afbb40a4d55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:35.824550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6bd53974-ec77-4c96-a285-afbb40a4d55d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:51:35.826082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6bd53974-ec77-4c96-a285-afbb40a4d55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:35.835382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1243/2495] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:51:35.858685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:35.861053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:35.876861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f480d0-4788-4403-8bed-95379eb16dda service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:35.882594 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:35.883275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:35.883558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:35.883835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:35.892479 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:35.894099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:35.904266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1253/2496] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:51:40.261085 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b991c-dd40-4bf3-9e07-265a027cab9a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:40.261701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b991c-dd40-4bf3-9e07-265a027cab9a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:40.261701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b991c-dd40-4bf3-9e07-265a027cab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:40.280249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-dd3b991c-dd40-4bf3-9e07-265a027cab9a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:51:40.282165 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dd3b991c-dd40-4bf3-9e07-265a027cab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:40.290011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1244/2497] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:51:40.307313 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:40.318426 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424f173-4bb6-4737-8761-298fb16182ac service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:40.323925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:40.324579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:40.325119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:40.325387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:40.334682 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:40.336263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:40.347478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1254/2498] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:51:44.179127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d733c-6be4-4733-8296-f7242593cfe6 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:44.179664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d733c-6be4-4733-8296-f7242593cfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:44.179664 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d733c-6be4-4733-8296-f7242593cfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:44.199362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-743d733c-6be4-4733-8296-f7242593cfe6 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:51:44.200805 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-743d733c-6be4-4733-8296-f7242593cfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:44.209323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1245/2499] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:51:44.224776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:44.236800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d6d3b-265f-4094-8d39-e93adc6e9ddf service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:44.242484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:44.243136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:44.243417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:44.243802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:44.254242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:44.256267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:44.266830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1255/2500] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:51:48.530497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0810e1-d8a3-4e32-8a24-f0601969d65a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:48.540170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0810e1-d8a3-4e32-8a24-f0601969d65a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:48.540170 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0810e1-d8a3-4e32-8a24-f0601969d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:48.550873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-fd0810e1-d8a3-4e32-8a24-f0601969d65a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:51:48.552181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fd0810e1-d8a3-4e32-8a24-f0601969d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:48.560154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1246/2501] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:51:48.576037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:48.587660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6ccaa-ea3c-4dac-9a2d-0bc5bf0d95ad service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:48.593862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:48.594563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:48.594848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:48.595123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:48.603201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:48.604769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:48.614183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1256/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:51:52.782070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf382-87ee-49bb-b71a-2b6b6c81254a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:52.782690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf382-87ee-49bb-b71a-2b6b6c81254a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:52.782690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf382-87ee-49bb-b71a-2b6b6c81254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:52.811320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-f5faf382-87ee-49bb-b71a-2b6b6c81254a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:51:52.814256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f5faf382-87ee-49bb-b71a-2b6b6c81254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:52.829843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1247/2503] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:51:52.848560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:52.861093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4d43-35c9-49a0-8edf-80a3e974642a service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:52.867896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:52.868756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:52.869088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:52.869488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:52.880220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:52.882098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:52.893552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1257/2504] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:51:58.008515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf382-87ee-49bb-b71a-2b6b6c81254a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:51:58.016883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=19 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:58.023450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf382-87ee-49bb-b71a-2b6b6c81254a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:51:58.029057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:51:58.029739 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:51:58.030024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:51:58.030406 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:51:58.032619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:51:58.098134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:51:58.099830 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:51:58.110430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1248/2505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:51:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:02.887972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=36 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:08.121155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=27 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:08.787032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:08.808369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006248-b7aa-424c-9f80-aa2868453357 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:08.817614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06647eb-2c78-4e26-87e8-aa5ef8037d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:08.818312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06647eb-2c78-4e26-87e8-aa5ef8037d40 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:08.818596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06647eb-2c78-4e26-87e8-aa5ef8037d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:08.818864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06647eb-2c78-4e26-87e8-aa5ef8037d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:08.820674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e06647eb-2c78-4e26-87e8-aa5ef8037d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:08.834774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06647eb-2c78-4e26-87e8-aa5ef8037d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:08.840456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06647eb-2c78-4e26-87e8-aa5ef8037d40 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:08.848155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1258/2506] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:11.789383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:11.800717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ae3b-b45c-4822-a677-5f1383a58b23 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:11.806030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:11.806707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:11.806981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:11.807253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:11.809307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:11.822151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:11.826288 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:11.833942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1249/2507] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:12.683490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:12.684225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:12.684225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:12.705151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] MFA Rules not processed for user `9421ac586b614f11a47718b4eefa491b`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:52:12.706453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:12.713784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1259/2508] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:52:12.961218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:12.970708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78c110-1a02-4f13-9878-bd424448c37d service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:12.975124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abca475-c129-42c4-8ae0-0ae0f459a6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:12.975855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca475-c129-42c4-8ae0-0ae0f459a6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:12.976221 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca475-c129-42c4-8ae0-0ae0f459a6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:12.976574 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca475-c129-42c4-8ae0-0ae0f459a6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:12.978485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3abca475-c129-42c4-8ae0-0ae0f459a6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:12.992215 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abca475-c129-42c4-8ae0-0ae0f459a6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:12.993728 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abca475-c129-42c4-8ae0-0ae0f459a6f9 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:13.004155 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1250/2509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:52:13.419568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:13.425923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:13.520864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754543b-cb33-4d6d-b743-219c2447a734 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:13.527378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:13.528179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:13.528565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:13.529022 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:13.531723 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:13.546036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:13.547713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:13.558430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1260/2510] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:14.144025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f6a6-46e0-410b-a63c-ce02c2b7e52c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:14.144493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f6a6-46e0-410b-a63c-ce02c2b7e52c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:14.144588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f6a6-46e0-410b-a63c-ce02c2b7e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:14.163151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a466f6a6-46e0-410b-a63c-ce02c2b7e52c None None] MFA Rules not processed for user `a5bbefa9f11b462baa345257b9f3709d`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:52:14.164422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a466f6a6-46e0-410b-a63c-ce02c2b7e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:14.172630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1251/2511] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:52:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:52:21.019204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:21.025920 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:21.112779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6857-fcc5-46ff-a43b-63933e2691a7 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:21.116997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:21.117890 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:21.118106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:21.118382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:21.120685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:21.162400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:21.164327 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:21.176480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1261/2512] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:24.157921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=15 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:26.349329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466f6a6-46e0-410b-a63c-ce02c2b7e52c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:26.395188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466f6a6-46e0-410b-a63c-ce02c2b7e52c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:26.405222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:26.406698 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:26.407217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:26.407903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:26.411254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:26.437169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:26.440184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:26.464428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1252/2513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:31.170232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=75 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:33.342501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:33.358101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8ede-6ac5-4010-a08d-2998129d063e service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:33.364217 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06393-a906-4d3d-aef2-6dee24266bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:33.365402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06393-a906-4d3d-aef2-6dee24266bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:33.366516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06393-a906-4d3d-aef2-6dee24266bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:33.367151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06393-a906-4d3d-aef2-6dee24266bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:33.369399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a9a06393-a906-4d3d-aef2-6dee24266bd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:33.479058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06393-a906-4d3d-aef2-6dee24266bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:33.480548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06393-a906-4d3d-aef2-6dee24266bd8 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:33.492957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1262/2514] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:35.176279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:35.189219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9afa-938c-4104-adac-7f3fe999ef91 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:35.195563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:35.196251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:35.196524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:35.196799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:35.198769 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:35.213748 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:35.215385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:35.229061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1253/2515] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:52:38.958681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa56e5-fd3f-4a2c-ae36-4cb115f3d8fe None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:38.959436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa56e5-fd3f-4a2c-ae36-4cb115f3d8fe None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:38.959436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa56e5-fd3f-4a2c-ae36-4cb115f3d8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:39.068703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9aaa56e5-fd3f-4a2c-ae36-4cb115f3d8fe None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:52:39.070548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9aaa56e5-fd3f-4a2c-ae36-4cb115f3d8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:39.108821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1263/2516] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:52:39.268439 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:39.291422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8e45f-b405-4ebf-9a04-ac8537aa5b27 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:39.302930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:39.304118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:39.304753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:39.305265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:39.322387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:39.326384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:39.347552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1254/2517] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:45.626024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08aa33-d480-477c-9d66-4c80ac75c6ac None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:45.627239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08aa33-d480-477c-9d66-4c80ac75c6ac None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:45.627239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08aa33-d480-477c-9d66-4c80ac75c6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:45.651282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5b08aa33-d480-477c-9d66-4c80ac75c6ac None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:52:45.652566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5b08aa33-d480-477c-9d66-4c80ac75c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:45.662291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1264/2518] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:52:45.678420 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:45.697186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42601216-9110-42d0-b33a-ade805a2ff91 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:45.706180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320167b3-126a-445e-b429-7b90c9d3b427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:45.708409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320167b3-126a-445e-b429-7b90c9d3b427 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:45.709771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320167b3-126a-445e-b429-7b90c9d3b427 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:45.710083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320167b3-126a-445e-b429-7b90c9d3b427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:45.734101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320167b3-126a-445e-b429-7b90c9d3b427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:45.737648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320167b3-126a-445e-b429-7b90c9d3b427 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:45.760758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1255/2519] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:47.747518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3b065-9903-48a2-a81d-4a44ab9f733d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:47.748308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3b065-9903-48a2-a81d-4a44ab9f733d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:47.748308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3b065-9903-48a2-a81d-4a44ab9f733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:47.768194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e8b3b065-9903-48a2-a81d-4a44ab9f733d None None] MFA Rules not processed for user `e59b9b2fcf024b05a9d751a42713f012`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:52:47.769481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e8b3b065-9903-48a2-a81d-4a44ab9f733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:47.776676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1265/2520] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:52:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:52:51.612930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77caf1-e9d3-4244-977b-7643af885d06 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:51.613473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77caf1-e9d3-4244-977b-7643af885d06 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:51.613473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77caf1-e9d3-4244-977b-7643af885d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:51.637334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4b77caf1-e9d3-4244-977b-7643af885d06 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:52:51.639528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4b77caf1-e9d3-4244-977b-7643af885d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:51.647887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1256/2521] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:52:51.662703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3b065-9903-48a2-a81d-4a44ab9f733d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:51.681651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3b065-9903-48a2-a81d-4a44ab9f733d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:51.692615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754471a-d10e-4300-b26a-46f4698985ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:51.693793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754471a-d10e-4300-b26a-46f4698985ff service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:51.694297 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754471a-d10e-4300-b26a-46f4698985ff service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:51.694791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754471a-d10e-4300-b26a-46f4698985ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:51.712275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754471a-d10e-4300-b26a-46f4698985ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:51.716175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754471a-d10e-4300-b26a-46f4698985ff service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:51.743962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1266/2522] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:52:56.056031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77caf1-e9d3-4244-977b-7643af885d06 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:56.062436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=39 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:56.082642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77caf1-e9d3-4244-977b-7643af885d06 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:56.086922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:56.087592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:56.087882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:56.088144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:56.090332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:56.106726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:56.110174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:56.121613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1257/2523] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:52:58.147292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e01d-bb6b-4bbb-a414-9f5f851f40cf None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:58.160343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e01d-bb6b-4bbb-a414-9f5f851f40cf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:58.160343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e01d-bb6b-4bbb-a414-9f5f851f40cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:58.171601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6b70e01d-bb6b-4bbb-a414-9f5f851f40cf None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:52:58.172825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6b70e01d-bb6b-4bbb-a414-9f5f851f40cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:52:58.180862 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1267/2524] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:52:58.199436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:52:58.212442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9a414-a681-4252-b3a7-0c4e437e91c9 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:52:58.218564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:52:58.219212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:52:58.219794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:52:58.219958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:52:58.232387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:52:58.234156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:52:58.263508 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1258/2525] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:53:00.981380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e01d-bb6b-4bbb-a414-9f5f851f40cf None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:00.996751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e01d-bb6b-4bbb-a414-9f5f851f40cf None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:01.004288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:01.005086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:01.005429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:01.005817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:01.008107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:01.032663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:01.036283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:01.054617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1268/2526] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:53:01.137463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:01.140275 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:01.162332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbdf5e-325a-41ca-b459-4f31516b555a service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:01.173616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:01.174766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:01.175279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:01.175606 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] PATH_INFO: `/v3/users/c048ce9cc5484139a3c5f87b4e204809` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:01.177857 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c048ce9cc5484139a3c5f87b4e204809)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:01.180270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:01.408623 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c048ce9cc5484139a3c5f87b4e204809'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:01.409349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c048ce9cc5484139a3c5f87b4e204809'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:01.426680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c048ce9cc5484139a3c5f87b4e204809'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:01.437962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c048ce9cc5484139a3c5f87b4e204809'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:01.438851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-20459123-cecb-42e1-9d73-c2498ac3ac1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c048ce9cc5484139a3c5f87b4e204809'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:01.545773 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1259/2527] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:53:01 2022] DELETE /identity/v3/users/c048ce9cc5484139a3c5f87b4e204809 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:53:01.823676 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:01.835487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=80 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:01.842310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfec6b-a337-4760-8e2f-0003c4bdc096 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:01.943542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:01.945079 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:01.945589 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:01.946093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] PATH_INFO: `/v3/projects/02cbde0626274aa7ae99d6f994810786` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:01.948090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02cbde0626274aa7ae99d6f994810786)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:01.952449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:02.089438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02cbde0626274aa7ae99d6f994810786', 'request_id': 'req-ce17db17-ad77-49e4-afc2-121e00496560'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:02.177905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02cbde0626274aa7ae99d6f994810786', 'request_id': 'req-ce17db17-ad77-49e4-afc2-121e00496560'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:02.184478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02cbde0626274aa7ae99d6f994810786', 'request_id': 'req-ce17db17-ad77-49e4-afc2-121e00496560'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:02.198141 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] The token cache is being invalidate because project 02cbde0626274aa7ae99d6f994810786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:53:02.198440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:02.199432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ce17db17-ad77-49e4-afc2-121e00496560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:02.201850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1269/2528] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:53:01 2022] DELETE /identity/v3/projects/02cbde0626274aa7ae99d6f994810786 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:53:02.206761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63a61-c2c0-4986-aab4-0b5e8f303c32 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.207336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63a61-c2c0-4986-aab4-0b5e8f303c32 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.207336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63a61-c2c0-4986-aab4-0b5e8f303c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.229055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-56f63a61-c2c0-4986-aab4-0b5e8f303c32 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:02.231168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-56f63a61-c2c0-4986-aab4-0b5e8f303c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:02.333848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1260/2529] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:02.338411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359f271-e6d8-4006-8dba-cafdb0fbac28 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.338889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359f271-e6d8-4006-8dba-cafdb0fbac28 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.339234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359f271-e6d8-4006-8dba-cafdb0fbac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.371015 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5359f271-e6d8-4006-8dba-cafdb0fbac28 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:02.373055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5359f271-e6d8-4006-8dba-cafdb0fbac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:02.384193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1270/2530] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:53:02.388647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63a61-c2c0-4986-aab4-0b5e8f303c32 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:02.399423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63a61-c2c0-4986-aab4-0b5e8f303c32 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:02.404807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:02.405488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.405806 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.406084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.406832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:53:02.408295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:02.409107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:02.426807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1261/2531] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:53:02.431201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359f271-e6d8-4006-8dba-cafdb0fbac28 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:02.441079 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359f271-e6d8-4006-8dba-cafdb0fbac28 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:02.446351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:02.447042 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.447331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.447611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.448367 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:02.451202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:02.555408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1271/2532] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:53:02 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:02.565362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:02.580464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46360e-8521-478e-986f-fca5212f11da admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:02.618924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:02.661431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:02.662208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.662499 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.662780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.663483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:02.665633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:02.813726 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1262/2533] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:53:02 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:02.818003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:02.831172 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf53f3f-fef0-4894-acaf-6b46fecef74b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:02.836282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:02.836972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.837258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.837538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.838316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:02.840062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:02.851380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1272/2534] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:02.856073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:02.867132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f0aa5-3eed-4e8c-8eaf-279033cb7ec6 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:02.875869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1e289-4ae3-4a20-942c-a8c414f1a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:02.875869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e289-4ae3-4a20-942c-a8c414f1a5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.875869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e289-4ae3-4a20-942c-a8c414f1a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.875869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e289-4ae3-4a20-942c-a8c414f1a5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.876648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1e289-4ae3-4a20-942c-a8c414f1a5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:02.878181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1e289-4ae3-4a20-942c-a8c414f1a5ad admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:02.890951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1263/2535] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:02.896001 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:02.907045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18df68-9665-4b36-92e4-8e8d04778765 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:02.912215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:02.913259 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:02.916124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:02.916124 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] PATH_INFO: `/v3/projects/8c917010873d4793a859e3ff9ce99d76/users/dfe1a63794574c818bc46cdf9c4be125/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:02.931323 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c917010873d4793a859e3ff9ce99d76, user_id=dfe1a63794574c818bc46cdf9c4be125, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:02.934214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:03.030617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1273/2536] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:02 2022] PUT /identity/v3/projects/8c917010873d4793a859e3ff9ce99d76/users/dfe1a63794574c818bc46cdf9c4be125/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:03.043095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846401d-5bbb-4819-bc76-8defaf97b7b7 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:03.043095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846401d-5bbb-4819-bc76-8defaf97b7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:03.043095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846401d-5bbb-4819-bc76-8defaf97b7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:03.075568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0846401d-5bbb-4819-bc76-8defaf97b7b7 None None] MFA Rules not processed for user `dfe1a63794574c818bc46cdf9c4be125`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:03.076834 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0846401d-5bbb-4819-bc76-8defaf97b7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:03.173082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1264/2537] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:03.177629 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:03.204501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:03.251637 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee9f71-b54d-4fe6-aaf8-0283a72b310f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:03.257054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:03.257764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:03.258075 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:03.258451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:03.259235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:03.261354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:04.057523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1274/2538] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:53:03 2022] POST /identity/v3/projects => generated 375 bytes in 880 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:04.062272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846401d-5bbb-4819-bc76-8defaf97b7b7 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:04.073987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846401d-5bbb-4819-bc76-8defaf97b7b7 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:04.134966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:04.135640 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:04.135928 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:04.136209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:04.136901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:04.138905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:04.236229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1265/2539] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:53:04 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:04.240441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:04.252468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df090003-8501-455d-bf5c-1f5d2d42fdb6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:04.257905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:04.258618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:04.258900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:04.259370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:04.260328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:04.262164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:04.277363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1275/2540] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:04.278630 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:04.289746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17329-a2c4-42b3-8f5e-34e43c18c933 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:04.295848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:04.296746 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:04.297029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:04.297313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] PATH_INFO: `/v3/projects/ed46bab8fbb4414ba02d8f5a174f4efd/users/e77a639605fe4dfb9eb1a576c5911cac/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:04.329799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed46bab8fbb4414ba02d8f5a174f4efd, user_id=e77a639605fe4dfb9eb1a576c5911cac, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:04.333816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:04.482911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:04.488638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1266/2541] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:04 2022] PUT /identity/v3/projects/ed46bab8fbb4414ba02d8f5a174f4efd/users/e77a639605fe4dfb9eb1a576c5911cac/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:04.493064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:04.504886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83178b-8650-4ffb-9307-7da2243fc26a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:04.569772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df2627-cc34-4390-8b3d-4099e0b27296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:04.570483 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df2627-cc34-4390-8b3d-4099e0b27296 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:04.570842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df2627-cc34-4390-8b3d-4099e0b27296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:04.571180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df2627-cc34-4390-8b3d-4099e0b27296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:04.572036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df2627-cc34-4390-8b3d-4099e0b27296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:04.574345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df2627-cc34-4390-8b3d-4099e0b27296 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:04.588498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1276/2542] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:53:04.592333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:04.608306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eadc6f-f219-47eb-88ae-245c1df226d5 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:04.614912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:04.616396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:04.616694 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:04.617128 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] PATH_INFO: `/v3/projects/ed46bab8fbb4414ba02d8f5a174f4efd/users/e77a639605fe4dfb9eb1a576c5911cac/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:04.619298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed46bab8fbb4414ba02d8f5a174f4efd, user_id=e77a639605fe4dfb9eb1a576c5911cac, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:04.622625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:04.634278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1267/2543] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:04 2022] PUT /identity/v3/projects/ed46bab8fbb4414ba02d8f5a174f4efd/users/e77a639605fe4dfb9eb1a576c5911cac/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:04.645618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0b84-414a-44e0-b0a6-794ca5a00afb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:04.645940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0b84-414a-44e0-b0a6-794ca5a00afb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:04.646309 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0b84-414a-44e0-b0a6-794ca5a00afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:04.675772 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-51ee0b84-414a-44e0-b0a6-794ca5a00afb None None] MFA Rules not processed for user `e77a639605fe4dfb9eb1a576c5911cac`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:04.677078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-51ee0b84-414a-44e0-b0a6-794ca5a00afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:04.762540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1277/2544] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:04.780113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:04.782876 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:04.884306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79fa1b-8eb0-40d7-9b1c-4161c283a283 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:04.888843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:04.889507 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:04.889826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:04.890110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:04.974262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:04.975608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:04.993666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1268/2545] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:53:05.561630 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b75af-1fee-4267-8064-30c133b28057 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:05.562134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b75af-1fee-4267-8064-30c133b28057 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:05.562134 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b75af-1fee-4267-8064-30c133b28057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:05.582090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c64b75af-1fee-4267-8064-30c133b28057 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:05.583148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c64b75af-1fee-4267-8064-30c133b28057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:05.594976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:05.648950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1278/2546] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Jul 18 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:05.664190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:05.665768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:05.766239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67360f7b-ac7f-44e9-b4fc-f4a4eed23a40 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:05.772867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:05.773816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:05.774107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:05.774532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:05.789187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:05.790917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:05.802904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1269/2547] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:53:08.472902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b75af-1fee-4267-8064-30c133b28057 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:08.483749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b75af-1fee-4267-8064-30c133b28057 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:08.487865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf61ff7-53e4-43e8-b386-5d2e209066bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:08.488886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61ff7-53e4-43e8-b386-5d2e209066bd service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:08.489232 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61ff7-53e4-43e8-b386-5d2e209066bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:08.489598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61ff7-53e4-43e8-b386-5d2e209066bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:08.504370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf61ff7-53e4-43e8-b386-5d2e209066bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:08.506530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf61ff7-53e4-43e8-b386-5d2e209066bd service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:08.519463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1279/2548] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:53:15.797784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:18.513891 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=26 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:24.428050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:24.438918 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff86a7d-f195-48b6-b349-0cf94c50785d service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:24.444964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:24.446497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:24.447082 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:24.447543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] PATH_INFO: `/v3/users/dfe1a63794574c818bc46cdf9c4be125` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:24.449431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe1a63794574c818bc46cdf9c4be125)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:24.455870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:24.704060 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe1a63794574c818bc46cdf9c4be125'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:24.704663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe1a63794574c818bc46cdf9c4be125'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:24.718307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe1a63794574c818bc46cdf9c4be125'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:24.726819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe1a63794574c818bc46cdf9c4be125'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:24.727553 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe1a63794574c818bc46cdf9c4be125'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:24.835987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1270/2549] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:53:24 2022] DELETE /identity/v3/users/dfe1a63794574c818bc46cdf9c4be125 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:24.840682 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:24.841203 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:24.841311 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:24.859467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:24.860683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:24.924663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1280/2550] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:24.934909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:24.936563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:25.018620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c85-1833-4875-8eea-0d1ca4f3bb58 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:25.023112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:25.023760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:25.024048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:25.024322 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:25.033485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:25.035435 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:25.045341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1271/2551] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:53:25.545402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:25.546928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:25.560173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3768508-936a-4adf-af91-528bbb98dd5a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:25.566747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:25.567609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:25.567997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:25.568411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] PATH_INFO: `/v3/projects/8c917010873d4793a859e3ff9ce99d76` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:25.569976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c917010873d4793a859e3ff9ce99d76)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:25.572159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:25.690038 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c917010873d4793a859e3ff9ce99d76', 'request_id': 'req-a9caeec1-0e0e-4430-88f3-f3fd400a2564'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:25.818241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c917010873d4793a859e3ff9ce99d76', 'request_id': 'req-a9caeec1-0e0e-4430-88f3-f3fd400a2564'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:25.825140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c917010873d4793a859e3ff9ce99d76', 'request_id': 'req-a9caeec1-0e0e-4430-88f3-f3fd400a2564'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:25.838860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] The token cache is being invalidate because project 8c917010873d4793a859e3ff9ce99d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:53:25.839878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:25.840400 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:25.842240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1281/2552] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:53:25 2022] DELETE /identity/v3/projects/8c917010873d4793a859e3ff9ce99d76 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:53:25.846628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:25.857700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b70d-6f65-46c7-bc45-0be52fe4894e service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:25.918348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:25.919225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:25.919512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:25.919787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] PATH_INFO: `/v3/users/e77a639605fe4dfb9eb1a576c5911cac` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:25.921016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77a639605fe4dfb9eb1a576c5911cac)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:25.923227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:25.931340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:26.288883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77a639605fe4dfb9eb1a576c5911cac'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:26.289572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77a639605fe4dfb9eb1a576c5911cac'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:26.310025 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77a639605fe4dfb9eb1a576c5911cac'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:26.320217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77a639605fe4dfb9eb1a576c5911cac'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:26.320978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-cae429a9-122c-46fd-9850-9283a4a6411f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77a639605fe4dfb9eb1a576c5911cac'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:26.445161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1272/2553] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:53:25 2022] DELETE /identity/v3/users/e77a639605fe4dfb9eb1a576c5911cac => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:26.911392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:26.913343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:26.933829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caeec1-0e0e-4430-88f3-f3fd400a2564 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:27.009325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:27.010350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:27.010639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:27.010915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] PATH_INFO: `/v3/projects/ed46bab8fbb4414ba02d8f5a174f4efd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:27.012181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed46bab8fbb4414ba02d8f5a174f4efd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:27.014206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:27.296923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:27.314234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed46bab8fbb4414ba02d8f5a174f4efd', 'request_id': 'req-faba453a-6739-4bb4-87b1-c61b560b1438'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:27.423368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed46bab8fbb4414ba02d8f5a174f4efd', 'request_id': 'req-faba453a-6739-4bb4-87b1-c61b560b1438'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:27.430541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed46bab8fbb4414ba02d8f5a174f4efd', 'request_id': 'req-faba453a-6739-4bb4-87b1-c61b560b1438'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:27.442854 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] The token cache is being invalidate because project ed46bab8fbb4414ba02d8f5a174f4efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:53:27.443215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:27.443794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-faba453a-6739-4bb4-87b1-c61b560b1438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:27.445397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1282/2554] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:53:26 2022] DELETE /identity/v3/projects/ed46bab8fbb4414ba02d8f5a174f4efd => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:53:27.451583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90776c42-07b9-40ae-8031-fcf1b5cba653 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:27.452105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90776c42-07b9-40ae-8031-fcf1b5cba653 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:27.452236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90776c42-07b9-40ae-8031-fcf1b5cba653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:27.472124 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-90776c42-07b9-40ae-8031-fcf1b5cba653 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:27.473510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-90776c42-07b9-40ae-8031-fcf1b5cba653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:27.539038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1273/2555] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:27.548317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1373-5227-484f-b6c8-18e18b1a3da8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:27.548524 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1373-5227-484f-b6c8-18e18b1a3da8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:27.548811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1373-5227-484f-b6c8-18e18b1a3da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:27.568399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-14ee1373-5227-484f-b6c8-18e18b1a3da8 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:27.569611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-14ee1373-5227-484f-b6c8-18e18b1a3da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:27.577793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1283/2556] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:27.582175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90776c42-07b9-40ae-8031-fcf1b5cba653 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:27.592088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90776c42-07b9-40ae-8031-fcf1b5cba653 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:27.597111 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:27.598853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:27.599147 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:27.599428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:27.600176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:53:27.600515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:27.602237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:27.616990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1274/2557] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:53:27.623013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee1373-5227-484f-b6c8-18e18b1a3da8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:27.634059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee1373-5227-484f-b6c8-18e18b1a3da8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:27.639048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:27.639875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:27.640163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:27.640444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:27.641162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:27.643256 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:27.757607 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1284/2558] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:53:27 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:27.762333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:27.777539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9533-9b9a-42cd-8adb-e0ee71f75d6f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:27.851592 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:27.852428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:27.852718 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:27.853005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:27.854052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:27.856488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:27.939171 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:27.947954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1275/2559] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:53:27 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:27.949562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:27.961892 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab56f8-1656-4394-8376-af9673f2ef00 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:27.967973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:27.968684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:27.968973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:27.969249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:27.970037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:27.986716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:27.986716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1285/2560] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:53:27.990254 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:28.001303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c739064-d7d7-471f-819c-9921667b442d admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:28.008668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efb7b-f71e-4fc8-94e6-28d7a110d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:28.019225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efb7b-f71e-4fc8-94e6-28d7a110d098 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.019225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efb7b-f71e-4fc8-94e6-28d7a110d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.019225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efb7b-f71e-4fc8-94e6-28d7a110d098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.019225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efb7b-f71e-4fc8-94e6-28d7a110d098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:28.019225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efb7b-f71e-4fc8-94e6-28d7a110d098 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:28.024100 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1276/2561] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:53:28.028389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:28.040801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa1d7-2c90-495a-afb3-1c72a37134f3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:28.045840 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:28.046780 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.047065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.047347 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] PATH_INFO: `/v3/projects/e45026b3415b4a55951d0d6bd7dd80bf/users/5718e2f585c24232a6bc9b2daf40e01e/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.063923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45026b3415b4a55951d0d6bd7dd80bf, user_id=5718e2f585c24232a6bc9b2daf40e01e, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:28.066680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:28.162614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1286/2562] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:28 2022] PUT /identity/v3/projects/e45026b3415b4a55951d0d6bd7dd80bf/users/5718e2f585c24232a6bc9b2daf40e01e/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:28.173667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e1437-ef06-4156-88b3-7f5f71383131 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.173992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e1437-ef06-4156-88b3-7f5f71383131 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.174278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e1437-ef06-4156-88b3-7f5f71383131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.205921 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-927e1437-ef06-4156-88b3-7f5f71383131 None None] MFA Rules not processed for user `5718e2f585c24232a6bc9b2daf40e01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:28.207764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-927e1437-ef06-4156-88b3-7f5f71383131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:28.301252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1277/2563] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:28.315383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:28.383059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412142c2-95e7-415a-a1b4-82b487be3c92 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:28.388267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:28.388936 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.389220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.389493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.390237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:28.392155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:28.516515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1287/2564] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:53:28 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:28.521671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e1437-ef06-4156-88b3-7f5f71383131 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:28.532971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e1437-ef06-4156-88b3-7f5f71383131 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:28.595108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:28.595716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.596002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.596313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.597053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:28.599058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:28.744317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1278/2565] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:53:28 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:53:28.748610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:28.760299 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b92c2-86bb-4f77-815c-4364b6d4c66f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:28.765087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:28.765787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.766078 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.766358 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.767094 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:28.768768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:28.781467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1288/2566] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:28.786281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:28.796667 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253f4c7-6b09-4364-bc06-68cc348b4536 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:28.801432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:28.802849 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.804136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.804449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] PATH_INFO: `/v3/projects/2c41f173a388469796e02add216c75e6/users/b564d9446fa140888c9693ea80ff341e/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.820563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c41f173a388469796e02add216c75e6, user_id=b564d9446fa140888c9693ea80ff341e, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:28.823757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:28.903745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1279/2567] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:28 2022] PUT /identity/v3/projects/2c41f173a388469796e02add216c75e6/users/b564d9446fa140888c9693ea80ff341e/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:28.907957 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:28.918530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6475f-e1b3-4612-b615-e1c26390ff9d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:28.939482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:28.978894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caddf3-f628-4438-8ad3-d4db69cbfc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:28.979591 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caddf3-f628-4438-8ad3-d4db69cbfc45 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:28.979848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caddf3-f628-4438-8ad3-d4db69cbfc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:28.980123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caddf3-f628-4438-8ad3-d4db69cbfc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:28.980921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caddf3-f628-4438-8ad3-d4db69cbfc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:28.982557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caddf3-f628-4438-8ad3-d4db69cbfc45 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:28.994059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1289/2568] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:28.998424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:29.010001 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403aa3-ef32-461c-ac95-850586d65dd1 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:29.015053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:29.015988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:29.016375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:29.016552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] PATH_INFO: `/v3/projects/2c41f173a388469796e02add216c75e6/users/b564d9446fa140888c9693ea80ff341e/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:29.018647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c41f173a388469796e02add216c75e6, user_id=b564d9446fa140888c9693ea80ff341e, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:29.021895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:29.033144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1280/2569] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:28 2022] PUT /identity/v3/projects/2c41f173a388469796e02add216c75e6/users/b564d9446fa140888c9693ea80ff341e/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:29.044270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:29.044493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:29.045091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:29.073098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] MFA Rules not processed for user `b564d9446fa140888c9693ea80ff341e`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:29.074611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:29.143399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1290/2570] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:29.154920 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:29.157145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:29.195142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:29.220675 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a5b2-a64c-4a30-87f8-980f32ad7348 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:29.224756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:29.225458 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:29.225775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:29.226058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:29.236099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:29.240130 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:29.249075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1281/2571] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:53:29.359407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:29.360884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:29.375267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760e2da-af71-4093-811d-b244cd9fe7b7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:29.380133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858117e-232d-4c1e-a9e9-de64484e6df8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:29.381055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858117e-232d-4c1e-a9e9-de64484e6df8 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:29.381352 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858117e-232d-4c1e-a9e9-de64484e6df8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:29.381640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858117e-232d-4c1e-a9e9-de64484e6df8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:29.459777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858117e-232d-4c1e-a9e9-de64484e6df8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:29.461856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858117e-232d-4c1e-a9e9-de64484e6df8 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:29.472535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1291/2572] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:53:32.769862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:32.849176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d83b9d-2c29-46af-8890-d9aacdb7c8a5 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:32.854466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:32.855333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:32.855616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:32.855887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] PATH_INFO: `/v3/users/5718e2f585c24232a6bc9b2daf40e01e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:32.857083 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5718e2f585c24232a6bc9b2daf40e01e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:32.859087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:33.095539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5718e2f585c24232a6bc9b2daf40e01e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:33.096204 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5718e2f585c24232a6bc9b2daf40e01e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:33.109952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5718e2f585c24232a6bc9b2daf40e01e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:33.118097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5718e2f585c24232a6bc9b2daf40e01e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:33.118981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5718e2f585c24232a6bc9b2daf40e01e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:33.192999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1282/2573] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:53:32 2022] DELETE /identity/v3/users/5718e2f585c24232a6bc9b2daf40e01e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:33.197868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:33.198687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:33.198687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:33.217148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:33.218520 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:33.262619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:33.282849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1292/2574] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:33.293332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:33.295494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:33.363129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54d5f8-57d6-42ff-8ef0-22226cbc1dbc admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:33.368003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:33.368688 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:33.368974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:33.369256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:33.377393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:33.380741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:33.390449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:33.393220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1283/2575] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:53:33.832005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:33.836069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:33.857412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7e330-4897-4f6b-bb93-4c656c35a0cb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:33.868585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:33.868585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:33.868585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:33.868585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] PATH_INFO: `/v3/projects/e45026b3415b4a55951d0d6bd7dd80bf` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:33.869316 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45026b3415b4a55951d0d6bd7dd80bf)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:33.871067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:33.994487 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45026b3415b4a55951d0d6bd7dd80bf', 'request_id': 'req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.085832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45026b3415b4a55951d0d6bd7dd80bf', 'request_id': 'req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.092147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45026b3415b4a55951d0d6bd7dd80bf', 'request_id': 'req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.107982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] The token cache is being invalidate because project e45026b3415b4a55951d0d6bd7dd80bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:53:34.108269 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.109102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.110722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1293/2576] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:53:33 2022] DELETE /identity/v3/projects/e45026b3415b4a55951d0d6bd7dd80bf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:34.115766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:34.130642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0894e8-14de-43a7-8f95-41f2a1a2cb32 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:34.191437 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:34.192624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:34.192624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:34.192897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] PATH_INFO: `/v3/users/b564d9446fa140888c9693ea80ff341e` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:34.194281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b564d9446fa140888c9693ea80ff341e)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:34.196225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:34.416524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b564d9446fa140888c9693ea80ff341e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.417108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b564d9446fa140888c9693ea80ff341e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.430761 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b564d9446fa140888c9693ea80ff341e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.438368 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b564d9446fa140888c9693ea80ff341e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.439107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-0b3848fd-4584-471e-a56a-31c61a52e1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b564d9446fa140888c9693ea80ff341e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:34.514961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1284/2577] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:53:34 2022] DELETE /identity/v3/users/b564d9446fa140888c9693ea80ff341e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:34.977794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:34.978548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:34.993908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a7bf7-6f98-4a5b-8eb8-d66e55ed793b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:35.053654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:35.054566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.054837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.055116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] PATH_INFO: `/v3/projects/2c41f173a388469796e02add216c75e6` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.056324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c41f173a388469796e02add216c75e6)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:35.058288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:35.158361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c41f173a388469796e02add216c75e6', 'request_id': 'req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:35.234706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c41f173a388469796e02add216c75e6', 'request_id': 'req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:35.246382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c41f173a388469796e02add216c75e6', 'request_id': 'req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:35.255513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:35.261160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] The token cache is being invalidate because project 2c41f173a388469796e02add216c75e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:53:35.261160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:35.261802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b4266dd9-e2f5-4af2-b37c-b1704c0193fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:35.263773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1294/2578] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:53:34 2022] DELETE /identity/v3/projects/2c41f173a388469796e02add216c75e6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:35.269491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d44e6b-6962-4160-81ae-e79f0061803f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.270006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d44e6b-6962-4160-81ae-e79f0061803f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.270182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d44e6b-6962-4160-81ae-e79f0061803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.296376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-74d44e6b-6962-4160-81ae-e79f0061803f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:35.297599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-74d44e6b-6962-4160-81ae-e79f0061803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:35.360389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1285/2579] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:35.370242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82256-96bb-474c-ab35-fec2b8d740dc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.370584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82256-96bb-474c-ab35-fec2b8d740dc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.370929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82256-96bb-474c-ab35-fec2b8d740dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.391050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d1f82256-96bb-474c-ab35-fec2b8d740dc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:35.392284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d1f82256-96bb-474c-ab35-fec2b8d740dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:35.400562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1295/2580] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:35.405845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d44e6b-6962-4160-81ae-e79f0061803f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:35.423796 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d44e6b-6962-4160-81ae-e79f0061803f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:35.433364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:35.434095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.434362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.434779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.435516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:53:35.435819 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:35.437809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:35.452528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1286/2581] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:53:35.457985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f82256-96bb-474c-ab35-fec2b8d740dc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:35.467966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f82256-96bb-474c-ab35-fec2b8d740dc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:35.476231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:35.477330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.478064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.478553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.480020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:35.483855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:35.606039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1296/2582] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:53:35 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:35.610245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:35.616552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:35.622407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52a9c-b164-42b2-bceb-e74df54ebbd5 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:35.684312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:35.685044 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.685329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.685609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.686342 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:35.688356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:35.842312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1287/2583] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:53:35 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:35.846868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:35.857848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acd842-94bc-4617-9eb1-1514b2be9337 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:35.862702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:35.863377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.863662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.864440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.865244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:35.866904 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:35.878265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1297/2584] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:35.883088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:35.894017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9501-d332-411f-ad7b-6d3c875694f6 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:35.899089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b67a-c26c-4998-aba0-92da16dd7e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:35.899766 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b67a-c26c-4998-aba0-92da16dd7e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.900195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b67a-c26c-4998-aba0-92da16dd7e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.900480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b67a-c26c-4998-aba0-92da16dd7e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.901220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b67a-c26c-4998-aba0-92da16dd7e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:35.902887 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b67a-c26c-4998-aba0-92da16dd7e64 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:35.913797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1288/2585] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:35.918231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:35.929819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709fbf0-316a-4359-969d-6a9352f32df2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:35.934855 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:35.935749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:35.936044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:35.936326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] PATH_INFO: `/v3/projects/b85f5817bfc9464c80db4ae094edc750/users/3944c820f6ab4a5ebe7b05c0b3c5fc17/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:35.970214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85f5817bfc9464c80db4ae094edc750, user_id=3944c820f6ab4a5ebe7b05c0b3c5fc17, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:35.976305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:36.099548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1298/2586] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:35 2022] PUT /identity/v3/projects/b85f5817bfc9464c80db4ae094edc750/users/3944c820f6ab4a5ebe7b05c0b3c5fc17/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:36.109260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823351f-cccb-4ba0-80f6-0150beeef7b3 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:36.109600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823351f-cccb-4ba0-80f6-0150beeef7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:36.109873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823351f-cccb-4ba0-80f6-0150beeef7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:36.141518 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d823351f-cccb-4ba0-80f6-0150beeef7b3 None None] MFA Rules not processed for user `3944c820f6ab4a5ebe7b05c0b3c5fc17`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:36.142815 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d823351f-cccb-4ba0-80f6-0150beeef7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:36.230997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1289/2587] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:36.243789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:36.245659 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:36.315611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d4aa-5f37-4c8f-9652-4c15d75a4a37 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:36.320703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197511ce-f6bb-41f8-9850-7330f680c2cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:36.321507 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197511ce-f6bb-41f8-9850-7330f680c2cc service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:36.322052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197511ce-f6bb-41f8-9850-7330f680c2cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:36.322384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197511ce-f6bb-41f8-9850-7330f680c2cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:36.333251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197511ce-f6bb-41f8-9850-7330f680c2cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:36.334963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197511ce-f6bb-41f8-9850-7330f680c2cc service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:36.345418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1299/2588] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:53:36.372202 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823351f-cccb-4ba0-80f6-0150beeef7b3 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:36.441967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823351f-cccb-4ba0-80f6-0150beeef7b3 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:36.447074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:36.447986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:36.448530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:36.448812 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] PATH_INFO: `/v3/users/3944c820f6ab4a5ebe7b05c0b3c5fc17` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:36.450269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3944c820f6ab4a5ebe7b05c0b3c5fc17)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:36.452189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:36.469919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:36.653629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3944c820f6ab4a5ebe7b05c0b3c5fc17'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:36.654336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3944c820f6ab4a5ebe7b05c0b3c5fc17'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:36.668832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3944c820f6ab4a5ebe7b05c0b3c5fc17'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:36.677193 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3944c820f6ab4a5ebe7b05c0b3c5fc17'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:36.678157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3944c820f6ab4a5ebe7b05c0b3c5fc17'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:36.770146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1290/2589] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:53:36 2022] DELETE /identity/v3/users/3944c820f6ab4a5ebe7b05c0b3c5fc17 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:36.772609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:36.773088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:36.773381 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:36.791821 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:36.793051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:36.855112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1300/2590] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:36.866127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:36.867639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:36.931444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125d933-b9ba-4cf4-8e4b-665ee794aed0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:36.935682 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dc393-c7d7-4393-91aa-b1166dbd6b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:36.936354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc393-c7d7-4393-91aa-b1166dbd6b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:36.936641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc393-c7d7-4393-91aa-b1166dbd6b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:36.936932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc393-c7d7-4393-91aa-b1166dbd6b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:36.947991 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dc393-c7d7-4393-91aa-b1166dbd6b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:36.951003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dc393-c7d7-4393-91aa-b1166dbd6b2d service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:36.961714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1291/2591] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:53:37.420784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:37.422414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:37.436837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bc78a-daee-44fe-9782-deaa5123efab None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:37.441725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:37.442776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:37.443057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:37.445090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] PATH_INFO: `/v3/projects/b85f5817bfc9464c80db4ae094edc750` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:37.445090 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85f5817bfc9464c80db4ae094edc750)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:37.446477 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:37.553568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:37.565832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85f5817bfc9464c80db4ae094edc750', 'request_id': 'req-8443d791-151c-4ac2-9204-f21e2652870a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:37.620289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85f5817bfc9464c80db4ae094edc750', 'request_id': 'req-8443d791-151c-4ac2-9204-f21e2652870a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:37.626563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85f5817bfc9464c80db4ae094edc750', 'request_id': 'req-8443d791-151c-4ac2-9204-f21e2652870a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:37.638668 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] The token cache is being invalidate because project b85f5817bfc9464c80db4ae094edc750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:53:37.638958 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:37.639620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8443d791-151c-4ac2-9204-f21e2652870a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:37.641176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1301/2592] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:53:37 2022] DELETE /identity/v3/projects/b85f5817bfc9464c80db4ae094edc750 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:37.646845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e01ac-1ee8-4baf-a656-48e1184620e7 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:37.648881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e01ac-1ee8-4baf-a656-48e1184620e7 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:37.648881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e01ac-1ee8-4baf-a656-48e1184620e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:37.666475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-612e01ac-1ee8-4baf-a656-48e1184620e7 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:37.667697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-612e01ac-1ee8-4baf-a656-48e1184620e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:37.734953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1292/2593] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:53:37.743176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd7df-b16f-4744-8ef0-1fa832cfd2bc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:37.743467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd7df-b16f-4744-8ef0-1fa832cfd2bc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:37.743746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd7df-b16f-4744-8ef0-1fa832cfd2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:37.762841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-969bd7df-b16f-4744-8ef0-1fa832cfd2bc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:37.764080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-969bd7df-b16f-4744-8ef0-1fa832cfd2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:37.772588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1302/2594] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:53:37.776870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e01ac-1ee8-4baf-a656-48e1184620e7 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:37.787879 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e01ac-1ee8-4baf-a656-48e1184620e7 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:37.792782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:37.793454 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:37.793779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:37.794081 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:37.794822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:53:37.795139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:37.796860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:37.810578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1293/2595] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:53:37.814979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd7df-b16f-4744-8ef0-1fa832cfd2bc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:37.826086 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd7df-b16f-4744-8ef0-1fa832cfd2bc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:37.831095 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:37.831774 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:37.832254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:37.833127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:37.833359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:37.835440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:37.931515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1303/2596] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:53:37 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:53:37.935919 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:37.946416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43225dc8-0c84-49e6-994e-d104d4ae707e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:37.965151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:38.010131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:38.010938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:38.011148 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:38.011333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:38.012011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:38.014196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:38.143423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1294/2597] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:53:37 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:53:38.148019 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:38.158302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932de47-21c3-48b3-a88d-5d7da7d21047 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:38.163558 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:38.164261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:38.164547 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:38.164825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:38.165555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:38.167189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:38.178041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1304/2598] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:38.182480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:38.193253 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb20ac-a22f-465f-b0de-4f01285fe1a2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:38.198567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6b459-5de9-49cb-9b1e-3f6d386f2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:38.199236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6b459-5de9-49cb-9b1e-3f6d386f2fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:38.199520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6b459-5de9-49cb-9b1e-3f6d386f2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:38.199800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6b459-5de9-49cb-9b1e-3f6d386f2fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:38.200539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6b459-5de9-49cb-9b1e-3f6d386f2fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:38.202233 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6b459-5de9-49cb-9b1e-3f6d386f2fe5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:38.213479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1295/2599] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:53:38.219986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:38.233861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b27aa-1108-44b6-8731-e6b434d7a92b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:38.238590 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:38.239459 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:38.239740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:38.240016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] PATH_INFO: `/v3/projects/0ede71d208c2449e8ec181c6252ee889/users/5d7f64981ba34abb8e4e04e68529640b/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:38.263132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ede71d208c2449e8ec181c6252ee889, user_id=5d7f64981ba34abb8e4e04e68529640b, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:38.263132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:38.349831 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1305/2600] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:53:38 2022] PUT /identity/v3/projects/0ede71d208c2449e8ec181c6252ee889/users/5d7f64981ba34abb8e4e04e68529640b/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:38.361733 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:38.362033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:38.362472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:38.392345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] MFA Rules not processed for user `5d7f64981ba34abb8e4e04e68529640b`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:53:38.393607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:38.463503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1296/2601] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:53:38.476999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:38.478894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:38.539350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092ea0-33b0-43fd-99db-136c677534ca admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:38.543251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:38.543907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:38.544195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:38.544475 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:38.553794 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:38.555274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:38.564761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1306/2602] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:53:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:53:44.081344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:44.082985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:53:44.155185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9351f8-56ec-4341-80f4-05653a5745b5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:44.159740 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:44.160616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:44.160903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:44.161183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] PATH_INFO: `/v3/users/9421ac586b614f11a47718b4eefa491b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:44.162457 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9421ac586b614f11a47718b4eefa491b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:44.164969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:44.364930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:44.379207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9421ac586b614f11a47718b4eefa491b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:44.383183 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9421ac586b614f11a47718b4eefa491b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:44.392185 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9421ac586b614f11a47718b4eefa491b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:44.400056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9421ac586b614f11a47718b4eefa491b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:44.400836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9421ac586b614f11a47718b4eefa491b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:44.459114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1297/2603] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:53:44 2022] DELETE /identity/v3/users/9421ac586b614f11a47718b4eefa491b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:44.703613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:53:44.716757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519405ff-7d3c-4147-98bc-1dc75f82537f service glance] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:53:44.778412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:53:44.779314 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:53:44.779596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:53:44.779870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] PATH_INFO: `/v3/projects/9cf95afedeff42498e7ea78d03ff08df` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:53:44.781145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf95afedeff42498e7ea78d03ff08df)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:53:44.783116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:53:44.786928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:44.904312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf95afedeff42498e7ea78d03ff08df', 'request_id': 'req-e912b61d-cea5-46ca-8b97-9b98decb7fc8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:44.994632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf95afedeff42498e7ea78d03ff08df', 'request_id': 'req-e912b61d-cea5-46ca-8b97-9b98decb7fc8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:45.000933 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf95afedeff42498e7ea78d03ff08df', 'request_id': 'req-e912b61d-cea5-46ca-8b97-9b98decb7fc8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:45.014236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] The token cache is being invalidate because project 9cf95afedeff42498e7ea78d03ff08df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:53:45.016292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:45.016292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e912b61d-cea5-46ca-8b97-9b98decb7fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:53:45.016706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1307/2604] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:53:44 2022] DELETE /identity/v3/projects/9cf95afedeff42498e7ea78d03ff08df => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:53:54.506525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=18,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:55.012147 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:12.017996 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:12.019450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:12.034377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fab817-35d9-4482-8c68-f9a74a59768b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:12.096560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:12.097440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:12.097753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:12.098028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] PATH_INFO: `/v3/users/5d7f64981ba34abb8e4e04e68529640b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:12.099416 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7f64981ba34abb8e4e04e68529640b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:12.101426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:12.289194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7f64981ba34abb8e4e04e68529640b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:12.289957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7f64981ba34abb8e4e04e68529640b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:12.302646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7f64981ba34abb8e4e04e68529640b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:12.309939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7f64981ba34abb8e4e04e68529640b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:12.310954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7f64981ba34abb8e4e04e68529640b'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:12.428768 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1298/2605] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:54:12 2022] DELETE /identity/v3/users/5d7f64981ba34abb8e4e04e68529640b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:54:12.433615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:12.434174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:12.434326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:12.453429 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:12.454692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:12.514888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1308/2606] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:12.524784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:12.527502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:12.584948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1915216-90e1-4851-b166-64c6c046ce86 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:12.589527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988949-7c03-445d-b0a1-f2bc587b7078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:12.590205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988949-7c03-445d-b0a1-f2bc587b7078 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:12.590495 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988949-7c03-445d-b0a1-f2bc587b7078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:12.590765 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988949-7c03-445d-b0a1-f2bc587b7078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:12.599865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988949-7c03-445d-b0a1-f2bc587b7078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:12.601297 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988949-7c03-445d-b0a1-f2bc587b7078 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:12.611220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1299/2607] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:54:13.043513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:13.045499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:13.061543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b2d2c-363a-40d1-8bab-19ed3f71c397 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:13.076065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:13.076976 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.077263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.077539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] PATH_INFO: `/v3/projects/0ede71d208c2449e8ec181c6252ee889` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.078823 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ede71d208c2449e8ec181c6252ee889)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:13.080747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:13.220145 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ede71d208c2449e8ec181c6252ee889', 'request_id': 'req-39d48eb0-261e-4739-a5e2-d326f594d5b3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:13.299998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ede71d208c2449e8ec181c6252ee889', 'request_id': 'req-39d48eb0-261e-4739-a5e2-d326f594d5b3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:13.308312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ede71d208c2449e8ec181c6252ee889', 'request_id': 'req-39d48eb0-261e-4739-a5e2-d326f594d5b3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:13.321110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] The token cache is being invalidate because project 0ede71d208c2449e8ec181c6252ee889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:54:13.321588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:13.322470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-39d48eb0-261e-4739-a5e2-d326f594d5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:54:13.324522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1309/2608] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:54:13 2022] DELETE /identity/v3/projects/0ede71d208c2449e8ec181c6252ee889 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:54:13.330028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb1f8-69f5-4bf1-b9ce-e2871bad704b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.330521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb1f8-69f5-4bf1-b9ce-e2871bad704b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.330762 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb1f8-69f5-4bf1-b9ce-e2871bad704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.348906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-97eeb1f8-69f5-4bf1-b9ce-e2871bad704b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:13.350177 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-97eeb1f8-69f5-4bf1-b9ce-e2871bad704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:13.370367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:13.416088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1300/2609] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:13.424897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cbd84-fe20-4086-acc6-b8206e209dce None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.425189 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cbd84-fe20-4086-acc6-b8206e209dce None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.425505 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cbd84-fe20-4086-acc6-b8206e209dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.446139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-513cbd84-fe20-4086-acc6-b8206e209dce None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:13.447898 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-513cbd84-fe20-4086-acc6-b8206e209dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:13.458731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1310/2610] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:13.464585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb1f8-69f5-4bf1-b9ce-e2871bad704b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:13.475190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb1f8-69f5-4bf1-b9ce-e2871bad704b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:13.480906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:13.481586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.481905 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.482191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.482967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:54:13.483282 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:13.484928 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:13.498601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1301/2611] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 08:54:13.503146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cbd84-fe20-4086-acc6-b8206e209dce None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:13.513427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cbd84-fe20-4086-acc6-b8206e209dce None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:13.518233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:13.518939 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.523824 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.524163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.524901 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:13.527469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:13.622250 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1311/2612] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:54:13 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:54:13.623432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:13.633642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6247af-c33b-434a-a343-ba4c37fb0467 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:13.694051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:13.694886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.695287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.695572 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.696334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:13.699084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:13.867585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1302/2613] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:54:13 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:54:13.872087 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:13.882683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8168f38-afa8-4ffe-bed9-65f1d8addf22 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:13.887857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:13.903146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.903146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.903146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.903146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:13.903146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:13.903146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1312/2614] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:54:13.907132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:13.917565 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b9ce4-6ae7-455c-b87f-f0f6e5e14ec2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:13.922855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e696d-5474-4826-bfb9-a4e1bac3b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:13.922855 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e696d-5474-4826-bfb9-a4e1bac3b0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.923132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e696d-5474-4826-bfb9-a4e1bac3b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.923414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e696d-5474-4826-bfb9-a4e1bac3b0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.924145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e696d-5474-4826-bfb9-a4e1bac3b0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:13.925969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e696d-5474-4826-bfb9-a4e1bac3b0b3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:13.936390 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1303/2615] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:54:13.940677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:13.951961 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eae61-247a-4823-bdc9-7a1cd7fe5c00 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:13.956687 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:13.957570 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:13.957888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:13.958175 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] PATH_INFO: `/v3/projects/6d5c6b91cdb34d4583f177e691c25c2f/users/5fc92ccbc3b54cd286430ae18312d6fb/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:13.974651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5c6b91cdb34d4583f177e691c25c2f, user_id=5fc92ccbc3b54cd286430ae18312d6fb, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:13.977322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:14.060842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1313/2616] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:54:13 2022] PUT /identity/v3/projects/6d5c6b91cdb34d4583f177e691c25c2f/users/5fc92ccbc3b54cd286430ae18312d6fb/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:54:14.066141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:14.066440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:14.066729 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:14.086427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:14.087711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:14.149312 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1304/2617] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:14.159449 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:14.161126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:14.183743 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:14.220226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7074-8d4f-439a-b8f4-804765b33cce admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:14.224041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9719521-f907-4801-bc43-8594458b4d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:14.224683 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9719521-f907-4801-bc43-8594458b4d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:14.224966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9719521-f907-4801-bc43-8594458b4d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:14.225236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9719521-f907-4801-bc43-8594458b4d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:14.234595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9719521-f907-4801-bc43-8594458b4d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:14.239285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9719521-f907-4801-bc43-8594458b4d30 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:14.246490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1314/2618] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:54:15.027472 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:15.028910 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:15.063826 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:15.125267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f64af6-9727-46da-bd01-577538268ea5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:15.130862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:15.133369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:15.133369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:15.133369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:15.133960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:15.146311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:15.147916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:15.159123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1305/2619] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:54:20.241937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c89b54-35fd-4f05-9d3d-11860af52127 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:20.243462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c89b54-35fd-4f05-9d3d-11860af52127 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:20.244306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c89b54-35fd-4f05-9d3d-11860af52127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:20.287043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-10c89b54-35fd-4f05-9d3d-11860af52127 None None] MFA Rules not processed for user `5fc92ccbc3b54cd286430ae18312d6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:20.288619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-10c89b54-35fd-4f05-9d3d-11860af52127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:20.411007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1315/2620] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:54:20.414091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:20.427229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e883-3c0d-48d0-8c01-7d88563acd59 service placement] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:20.433035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:20.433758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:20.434247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:20.434816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:20.435719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:20.437763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:20.537737 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1306/2621] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:54:20 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:54:20.545886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c89b54-35fd-4f05-9d3d-11860af52127 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:20.559165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c89b54-35fd-4f05-9d3d-11860af52127 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:20.665351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:20.666310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:20.666444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:20.666649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:20.667896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:20.670072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:20.751056 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1316/2622] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:54:20 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:54:20.756514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:20.767223 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bbb05-04b6-4fb1-beaf-471fd05c2f1f admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:20.772190 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:20.772895 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:20.773180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:20.773456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:20.774235 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:20.775881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:20.786927 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1307/2623] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:54:20.791238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:20.802291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98bd3-aa7c-461e-bab8-092aedaf6f47 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:20.807342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:20.808912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:20.809272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:20.809583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] PATH_INFO: `/v3/projects/7f090db227874a9baabb6dba364be9e6/users/cf2c7132204a43b1b4cf357e35039500/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:20.828631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f090db227874a9baabb6dba364be9e6, user_id=cf2c7132204a43b1b4cf357e35039500, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:20.831411 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:20.932513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1317/2624] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:54:20 2022] PUT /identity/v3/projects/7f090db227874a9baabb6dba364be9e6/users/cf2c7132204a43b1b4cf357e35039500/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:54:20.936907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:20.948188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf18d5-70ce-4797-8c40-7339e0e680c1 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:21.011899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243426ae-86bf-47f5-b127-03543e7c2ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:21.012648 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243426ae-86bf-47f5-b127-03543e7c2ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:21.012936 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243426ae-86bf-47f5-b127-03543e7c2ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:21.013217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243426ae-86bf-47f5-b127-03543e7c2ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:21.014012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243426ae-86bf-47f5-b127-03543e7c2ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:21.015794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243426ae-86bf-47f5-b127-03543e7c2ad4 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:21.028367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1308/2625] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:54:21.033397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:21.047236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f99c6-9370-4ee8-95f3-0016f1fdc34f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:21.052850 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:21.053703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:21.054125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:21.054294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] PATH_INFO: `/v3/projects/7f090db227874a9baabb6dba364be9e6/users/cf2c7132204a43b1b4cf357e35039500/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:21.056515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f090db227874a9baabb6dba364be9e6, user_id=cf2c7132204a43b1b4cf357e35039500, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:21.059396 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:21.071919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1318/2626] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:54:21 2022] PUT /identity/v3/projects/7f090db227874a9baabb6dba364be9e6/users/cf2c7132204a43b1b4cf357e35039500/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:54:27.551345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee14743-179d-4dcc-8eca-fe332e5ce1cd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:27.551948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee14743-179d-4dcc-8eca-fe332e5ce1cd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:27.551948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee14743-179d-4dcc-8eca-fe332e5ce1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:27.592850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-aee14743-179d-4dcc-8eca-fe332e5ce1cd None None] MFA Rules not processed for user `cf2c7132204a43b1b4cf357e35039500`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:27.594619 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-aee14743-179d-4dcc-8eca-fe332e5ce1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:27.676483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:27.699939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1309/2627] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:54:27.712506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:27.716741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:27.726639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:27.829635 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a5a01-4f22-486b-8814-3a6362a892a5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:27.833599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:27.835841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:27.835841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:27.835841 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:27.917982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:27.920196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:27.932880 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1319/2628] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:54:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:54:28.301187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ab86-b4ca-418e-9b58-801c52475d16 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:28.301801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ab86-b4ca-418e-9b58-801c52475d16 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:28.302241 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ab86-b4ca-418e-9b58-801c52475d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:28.341697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e4e3ab86-b4ca-418e-9b58-801c52475d16 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:28.344320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e4e3ab86-b4ca-418e-9b58-801c52475d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:28.444533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1310/2629] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:28.610377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:28.612205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:28.703658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a6ee-0dc4-40e5-8614-2c859adca171 service glance] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:28.710955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:28.711640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:28.711930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:28.712213 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:28.723318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:28.725043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:28.735206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1320/2630] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:30.602750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d2a42-afcb-47d5-a8c4-5e3b57805c39 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:30.603583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d2a42-afcb-47d5-a8c4-5e3b57805c39 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:30.603583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d2a42-afcb-47d5-a8c4-5e3b57805c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:30.626552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b52d2a42-afcb-47d5-a8c4-5e3b57805c39 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:30.628086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b52d2a42-afcb-47d5-a8c4-5e3b57805c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:30.643136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1311/2631] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:30.685572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:30.708658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b0097-0cf1-4a39-b54e-3a51f6cfeaf6 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:30.718436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18c8c-03cd-40ef-aec6-b85e91a85a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:30.719125 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18c8c-03cd-40ef-aec6-b85e91a85a17 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:30.719412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18c8c-03cd-40ef-aec6-b85e91a85a17 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:30.719692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18c8c-03cd-40ef-aec6-b85e91a85a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:30.732024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f18c8c-03cd-40ef-aec6-b85e91a85a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:30.734102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f18c8c-03cd-40ef-aec6-b85e91a85a17 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:30.748929 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1321/2632] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:54:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:40.619050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=41 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:40.742332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=84 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:41.880797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc7250-41bf-46ab-9094-9b2e9b924063 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:41.881354 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc7250-41bf-46ab-9094-9b2e9b924063 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:41.881814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc7250-41bf-46ab-9094-9b2e9b924063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:41.903299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-0ddc7250-41bf-46ab-9094-9b2e9b924063 None None] MFA Rules not processed for user `5fc92ccbc3b54cd286430ae18312d6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:41.904678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0ddc7250-41bf-46ab-9094-9b2e9b924063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:41.916207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1312/2633] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:54:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:46.602020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715f7d-1e8f-449b-a207-08a848594c51 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:46.602020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715f7d-1e8f-449b-a207-08a848594c51 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:46.602020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715f7d-1e8f-449b-a207-08a848594c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:46.602020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2f715f7d-1e8f-449b-a207-08a848594c51 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:54:46.602020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2f715f7d-1e8f-449b-a207-08a848594c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:46.613833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1322/2634] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:54:46.630752 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc7250-41bf-46ab-9094-9b2e9b924063 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:46.647132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc7250-41bf-46ab-9094-9b2e9b924063 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:46.653432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:46.654257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:46.654548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:46.654912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:46.664229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:46.665932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:46.676689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1313/2635] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:54:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:48.213394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715f7d-1e8f-449b-a207-08a848594c51 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:54:48.332848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715f7d-1e8f-449b-a207-08a848594c51 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:54:48.337370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e905f9-cacd-4362-9176-4f20ad72bcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:54:48.338632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e905f9-cacd-4362-9176-4f20ad72bcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:54:48.338918 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e905f9-cacd-4362-9176-4f20ad72bcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:54:48.339199 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e905f9-cacd-4362-9176-4f20ad72bcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:54:48.344047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-40e905f9-cacd-4362-9176-4f20ad72bcb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:54:48.432082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e905f9-cacd-4362-9176-4f20ad72bcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:54:48.435922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e905f9-cacd-4362-9176-4f20ad72bcb8 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:54:48.447501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1323/2636] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:54:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:54:56.672756 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=9 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:58.440837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=51 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:08.351697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:08.353345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:08.367917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fb69b-2f55-4d3d-9194-f1d74e181d3c service swift] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:08.375005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478d5d8-0a40-4249-8799-19d9bb80e9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:08.375686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478d5d8-0a40-4249-8799-19d9bb80e9dd service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:08.375966 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478d5d8-0a40-4249-8799-19d9bb80e9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:08.376289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478d5d8-0a40-4249-8799-19d9bb80e9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:08.384705 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-3478d5d8-0a40-4249-8799-19d9bb80e9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:08.496534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478d5d8-0a40-4249-8799-19d9bb80e9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:08.498798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478d5d8-0a40-4249-8799-19d9bb80e9dd service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:08.511176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1314/2637] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:55:08.962838 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4316-fce8-4ed6-bf78-2193e07fe35d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:08.964112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4316-fce8-4ed6-bf78-2193e07fe35d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:08.964112 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4316-fce8-4ed6-bf78-2193e07fe35d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:08.967260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1324/2638] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:55:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:55:08.975371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657b7b-7629-47c9-9f42-cb545768f47f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:08.975720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657b7b-7629-47c9-9f42-cb545768f47f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:08.976115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657b7b-7629-47c9-9f42-cb545768f47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:09.037006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2f657b7b-7629-47c9-9f42-cb545768f47f None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:09.039309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2f657b7b-7629-47c9-9f42-cb545768f47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:09.182771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1315/2639] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:55:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:55:09.202244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f4316-fce8-4ed6-bf78-2193e07fe35d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:09.206196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3a1f4316-fce8-4ed6-bf78-2193e07fe35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:09.231738 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f4316-fce8-4ed6-bf78-2193e07fe35d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:09.238020 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb2885-67c1-45e9-bee6-fb7cf328957f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:09.239173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2885-67c1-45e9-bee6-fb7cf328957f service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:09.239662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2885-67c1-45e9-bee6-fb7cf328957f service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:09.240263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2885-67c1-45e9-bee6-fb7cf328957f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:09.261563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb2885-67c1-45e9-bee6-fb7cf328957f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:09.265975 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb2885-67c1-45e9-bee6-fb7cf328957f service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:09.297240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1325/2640] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:55:09.807207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344c863-7af9-4659-ac03-f719a35d2a74 None None] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:09.807767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344c863-7af9-4659-ac03-f719a35d2a74 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:09.807767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344c863-7af9-4659-ac03-f719a35d2a74 None None] PATH_INFO: `/` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:09.810196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1316/2641] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:55:09.815660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347740d-4559-44af-be1e-deedcb55b521 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:09.815960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347740d-4559-44af-be1e-deedcb55b521 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:09.816329 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347740d-4559-44af-be1e-deedcb55b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:09.853974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c347740d-4559-44af-be1e-deedcb55b521 None None] MFA Rules not processed for user `b40cb94150444c81ab1de3c6c1c1ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:09.855542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c347740d-4559-44af-be1e-deedcb55b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:09.866438 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1326/2642] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:55:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:55:09.880492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344c863-7af9-4659-ac03-f719a35d2a74 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:09.896952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344c863-7af9-4659-ac03-f719a35d2a74 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:09.901077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a704b5-a719-4976-a191-674f7e3418f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:09.901809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a704b5-a719-4976-a191-674f7e3418f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:09.902102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a704b5-a719-4976-a191-674f7e3418f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:09.902417 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a704b5-a719-4976-a191-674f7e3418f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:09.911722 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a704b5-a719-4976-a191-674f7e3418f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:09.913224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a704b5-a719-4976-a191-674f7e3418f2 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:09.924871 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1317/2643] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:55:10.056460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d08a2-1f89-4624-816b-c7a7b9a6945d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:10.057183 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d08a2-1f89-4624-816b-c7a7b9a6945d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:10.057423 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d08a2-1f89-4624-816b-c7a7b9a6945d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:10.059858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1327/2644] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 08:55:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 08:55:10.068255 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6961fe-80f7-4ee8-b5c2-dcd327abab35 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:10.074039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6961fe-80f7-4ee8-b5c2-dcd327abab35 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:10.074039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6961fe-80f7-4ee8-b5c2-dcd327abab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:10.094616 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ad6961fe-80f7-4ee8-b5c2-dcd327abab35 None None] MFA Rules not processed for user `df173c85777f45dd8ed9fb11bad366b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:10.095405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ad6961fe-80f7-4ee8-b5c2-dcd327abab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:10.112331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1318/2645] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 08:55:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:55:10.125468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d08a2-1f89-4624-816b-c7a7b9a6945d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:10.143040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d08a2-1f89-4624-816b-c7a7b9a6945d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:10.148221 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:10.149769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:10.149769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:10.149769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:10.163170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:10.164838 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:10.179102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1328/2646] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:55:15.121387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:15.122376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:15.122870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:15.148206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:15.149836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:15.158791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1319/2647] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:55:15.172208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:15.184142 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096f57-284f-4c8c-a6fc-13bc09037053 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:15.190305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:15.191325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:15.191767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:15.192230 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:15.212073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:15.214414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:15.225945 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1329/2648] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:55:21.301261 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:21.302946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:21.362755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:21.419017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02ddc-c5ef-4137-8ca9-509705766471 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:21.426310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:21.427028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:21.427371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:21.427649 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:21.429886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:21.450295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:21.452230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:21.469916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1320/2649] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:55:21.513866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:21.516304 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:21.541204 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437d41-1446-4ceb-beb4-c824cb9fd1d8 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:21.546956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:21.548345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:21.548888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:21.549749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] PATH_INFO: `/v3/users/f01abef1d27142e9aac438f187b93ca9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:21.551501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01abef1d27142e9aac438f187b93ca9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:21.553879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:21.830245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01abef1d27142e9aac438f187b93ca9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:21.834947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01abef1d27142e9aac438f187b93ca9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:21.861469 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01abef1d27142e9aac438f187b93ca9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:21.880309 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01abef1d27142e9aac438f187b93ca9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:21.881478 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01abef1d27142e9aac438f187b93ca9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:22.003302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1330/2650] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:55:21 2022] DELETE /identity/v3/users/f01abef1d27142e9aac438f187b93ca9 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:55:22.342274 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:22.395882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250ad6c-cad6-476c-aea3-165251ef0efd service placement] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:22.503091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:22.504356 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:22.504848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:22.505344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] PATH_INFO: `/v3/projects/5fddabdc83704d359f6748853f476442` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:22.508023 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fddabdc83704d359f6748853f476442)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:22.510823 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:22.728522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fddabdc83704d359f6748853f476442', 'request_id': 'req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:22.754144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fddabdc83704d359f6748853f476442', 'request_id': 'req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:22.769645 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fddabdc83704d359f6748853f476442', 'request_id': 'req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:22.847889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] The token cache is being invalidate because project 5fddabdc83704d359f6748853f476442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:55:22.848459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:22.850196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:22.852300 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1321/2651] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:55:22 2022] DELETE /identity/v3/projects/5fddabdc83704d359f6748853f476442 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:55:22.856512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:22.858119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:22.879349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2633d7d-4ee0-4096-aaac-59e729c00dd2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:22.979707 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:22.997826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:22.997826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:22.997826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] PATH_INFO: `/v3/users/e06fd33c6951412e97117b865414a963` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:22.997826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06fd33c6951412e97117b865414a963)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:22.997826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:23.881111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:24.047984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06fd33c6951412e97117b865414a963'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.048705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06fd33c6951412e97117b865414a963'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.072560 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06fd33c6951412e97117b865414a963'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.087769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06fd33c6951412e97117b865414a963'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.088534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06fd33c6951412e97117b865414a963'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.218623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1331/2652] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:55:22 2022] DELETE /identity/v3/users/e06fd33c6951412e97117b865414a963 => generated 0 bytes in 1363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:55:24.576015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:24.578591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:24.602567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797f2a0-5f3d-4d94-b4c1-eb85f33e5881 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:24.700093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:24.701094 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:24.701383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:24.701663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] PATH_INFO: `/v3/projects/3753337a3d0949f5979afb9fbe4855e9` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:24.703102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3753337a3d0949f5979afb9fbe4855e9)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:24.705141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:24.707071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:24.834111 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3753337a3d0949f5979afb9fbe4855e9', 'request_id': 'req-edb381b4-226a-4f79-b13d-8876ade470af'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.841515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3753337a3d0949f5979afb9fbe4855e9', 'request_id': 'req-edb381b4-226a-4f79-b13d-8876ade470af'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.849030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3753337a3d0949f5979afb9fbe4855e9', 'request_id': 'req-edb381b4-226a-4f79-b13d-8876ade470af'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.949845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] The token cache is being invalidate because project 3753337a3d0949f5979afb9fbe4855e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:55:24.950176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.951101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-edb381b4-226a-4f79-b13d-8876ade470af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:24.952814 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1322/2653] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:55:24 2022] DELETE /identity/v3/projects/3753337a3d0949f5979afb9fbe4855e9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:55:33.863394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:33.865532 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:33.939609 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af46a7f-d217-45fb-a5b0-44c8fab96912 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:34.004548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:34.005606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:34.006113 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:34.006595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:34.009956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:34.105305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:34.106853 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:34.121987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1332/2654] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:55:34.943612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:36.702090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:36.702720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:36.702903 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:36.731958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:36.734107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:36.851854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1323/2655] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:55:36.882409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:36.884684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:36.907597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:36.986605 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752cc3e-6b35-4479-b57b-f12d6c2dfb21 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:36.992902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:36.994407 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:36.994614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:36.994912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:37.005868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:37.007712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:37.019949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1333/2656] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:55:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:55:45.360582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:45.362355 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:45.376583 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07906ab-9fda-4f52-b28b-0a5d4fe467c8 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:45.380378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:45.381035 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:45.381353 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:45.381625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:45.383536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:45.459971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:45.461432 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:45.473763 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1324/2657] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:55:47.016467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=27 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:49.471554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:49.474470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:49.499874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc4de0-d523-44da-942c-b78dc18ae5a4 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:49.504721 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:49.505692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:49.506040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:49.506361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] PATH_INFO: `/v3/users/e59b9b2fcf024b05a9d751a42713f012` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:49.507734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59b9b2fcf024b05a9d751a42713f012)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:49.510941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:49.722703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59b9b2fcf024b05a9d751a42713f012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:49.723291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59b9b2fcf024b05a9d751a42713f012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:49.738955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59b9b2fcf024b05a9d751a42713f012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:49.747129 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59b9b2fcf024b05a9d751a42713f012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:49.747895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb31df5b-db67-4e47-8ccd-79d67a505e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59b9b2fcf024b05a9d751a42713f012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:49.830608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1334/2658] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:55:49 2022] DELETE /identity/v3/users/e59b9b2fcf024b05a9d751a42713f012 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:55:50.183510 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:50.194677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a576-a5d8-4e94-b01f-a99df52003ce service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:50.268488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:50.269362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:50.269647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:50.269957 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] PATH_INFO: `/v3/projects/e301dcf7df4142eea34f8f1bd6380b8a` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:50.271271 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e301dcf7df4142eea34f8f1bd6380b8a)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:50.273205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:50.445534 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:50.452569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e301dcf7df4142eea34f8f1bd6380b8a', 'request_id': 'req-b56d469a-a570-48c8-85d3-f1d7b1f048cb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:50.458613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e301dcf7df4142eea34f8f1bd6380b8a', 'request_id': 'req-b56d469a-a570-48c8-85d3-f1d7b1f048cb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:50.466196 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e301dcf7df4142eea34f8f1bd6380b8a', 'request_id': 'req-b56d469a-a570-48c8-85d3-f1d7b1f048cb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:50.553264 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] The token cache is being invalidate because project e301dcf7df4142eea34f8f1bd6380b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:55:50.553614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:50.554459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b56d469a-a570-48c8-85d3-f1d7b1f048cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:55:50.556451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1325/2659] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:55:50 2022] DELETE /identity/v3/projects/e301dcf7df4142eea34f8f1bd6380b8a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:55:50.565377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0008c29-794a-49bf-8906-cd23b160097f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:50.566061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0008c29-794a-49bf-8906-cd23b160097f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:50.566467 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0008c29-794a-49bf-8906-cd23b160097f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:50.587500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d0008c29-794a-49bf-8906-cd23b160097f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:50.589318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d0008c29-794a-49bf-8906-cd23b160097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:50.658796 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1335/2660] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:55:50.666916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235415b-2469-4145-905a-fd1b65fa13d2 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:50.667307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235415b-2469-4145-905a-fd1b65fa13d2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:50.667451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235415b-2469-4145-905a-fd1b65fa13d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:50.688343 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e235415b-2469-4145-905a-fd1b65fa13d2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:50.689430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e235415b-2469-4145-905a-fd1b65fa13d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:50.698594 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1326/2661] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:55:50.703127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0008c29-794a-49bf-8906-cd23b160097f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:50.715160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0008c29-794a-49bf-8906-cd23b160097f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:50.719991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:50.720666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:50.720956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:50.721231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:50.722024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:55:50.722334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:50.724179 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:50.736849 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1336/2662] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:55:50.741502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235415b-2469-4145-905a-fd1b65fa13d2 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:50.751110 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235415b-2469-4145-905a-fd1b65fa13d2 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:50.755930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:50.756595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:50.756875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:50.757149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:50.757881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:50.759804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:50.854931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1327/2663] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:55:50 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:55:50.859200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:50.869397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd145b4-65ee-43bf-86f2-ed8e2a629202 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:50.927671 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:50.928408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:50.928699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:50.928980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:50.930200 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:50.932883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:50.940324 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:51.019427 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1337/2664] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:55:50 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:55:51.024249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:51.036266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef00c3-fc26-44b5-98f3-8ac86d46c587 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:51.041070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:51.042489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:51.042781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:51.043065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:51.043807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:51.045496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:51.056687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1328/2665] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:55:51.061415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:51.074058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16930b-ed3d-44c3-9f52-f669da9b435c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:51.079462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc1ac5-dc67-4bbb-9021-51f01b3563a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:51.080280 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1ac5-dc67-4bbb-9021-51f01b3563a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:51.080571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1ac5-dc67-4bbb-9021-51f01b3563a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:51.080847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1ac5-dc67-4bbb-9021-51f01b3563a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:51.081805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc1ac5-dc67-4bbb-9021-51f01b3563a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:51.083538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc1ac5-dc67-4bbb-9021-51f01b3563a1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:51.095581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1338/2666] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:55:51.099899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:51.111525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12406778-fc0f-4287-8e42-c11917ef6489 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:51.117934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:51.119072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:51.119195 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:51.119550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] PATH_INFO: `/v3/projects/5cdb5bc15c11483aace0d9066a9e7707/users/5d57c26ab8cb4b81b0271887de8de62f/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:51.137889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdb5bc15c11483aace0d9066a9e7707, user_id=5d57c26ab8cb4b81b0271887de8de62f, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:51.140600 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:51.219548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1329/2667] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:55:51 2022] PUT /identity/v3/projects/5cdb5bc15c11483aace0d9066a9e7707/users/5d57c26ab8cb4b81b0271887de8de62f/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:55:51.225111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424319-2fcc-4a5a-8d76-636e31b53da5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:51.225562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424319-2fcc-4a5a-8d76-636e31b53da5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:51.225981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424319-2fcc-4a5a-8d76-636e31b53da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:51.244789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bb424319-2fcc-4a5a-8d76-636e31b53da5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:51.246076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bb424319-2fcc-4a5a-8d76-636e31b53da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:51.309225 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1339/2668] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:55:51.319139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:51.321131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:51.384641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b2cc7-a0b0-4a89-8304-b03a7d5e0354 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:51.389415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:51.390115 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:51.390404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:51.390687 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:51.401450 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:51.402967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:51.414091 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1330/2669] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:55:57.128674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d355e2a-c9aa-4e47-9025-37341c47c52c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:57.129271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d355e2a-c9aa-4e47-9025-37341c47c52c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:57.129271 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d355e2a-c9aa-4e47-9025-37341c47c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:57.160229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7d355e2a-c9aa-4e47-9025-37341c47c52c None None] MFA Rules not processed for user `5d57c26ab8cb4b81b0271887de8de62f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:55:57.161508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7d355e2a-c9aa-4e47-9025-37341c47c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:57.242658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1340/2670] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:55:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:55:57.260105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:55:57.263813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:55:57.342205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7e18-07ad-4c7b-8f8d-3be616813b48 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:55:57.348116 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:55:57.348885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:55:57.349173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:55:57.349455 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:55:57.355953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:57.366555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:55:57.366555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:55:57.373052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1331/2671] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:55:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:56:00.181255 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436209c-f5cd-4943-b945-f423a26e64f8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:00.182457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436209c-f5cd-4943-b945-f423a26e64f8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:00.182457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436209c-f5cd-4943-b945-f423a26e64f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:00.204167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0436209c-f5cd-4943-b945-f423a26e64f8 None None] MFA Rules not processed for user `5d57c26ab8cb4b81b0271887de8de62f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:00.205336 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0436209c-f5cd-4943-b945-f423a26e64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:00.213002 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1341/2672] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:07.781172 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:10.198588 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:13.742776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:13.752391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d4192-73b8-45c9-8a42-fa77a0cf9e73 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:13.756050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:13.756689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:13.756971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:13.757245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:13.759036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:13.773328 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:13.774809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:13.800377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1332/2673] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:56:23.782306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=6 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:35.563767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436209c-f5cd-4943-b945-f423a26e64f8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:35.574127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436209c-f5cd-4943-b945-f423a26e64f8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:35.578514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:35.579171 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:35.579461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:35.579728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:35.582098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:35.596717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:35.598623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:35.610440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1342/2674] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:56:43.871569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:43.881106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2529-2e5c-4dd3-9362-95c8d5111943 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:43.885409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:43.886207 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:43.886436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:43.886771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:43.888587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:43.901978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:43.903428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:43.914263 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1333/2675] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:56:45.605031 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:47.915982 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:47.917500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:47.932006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262139-e5b6-4eb7-9471-a45c8c09702d service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:47.937376 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:47.938320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:47.938608 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:47.938887 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] PATH_INFO: `/v3/users/a5bbefa9f11b462baa345257b9f3709d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:47.953789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bbefa9f11b462baa345257b9f3709d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:47.957962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:48.108746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bbefa9f11b462baa345257b9f3709d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.109537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bbefa9f11b462baa345257b9f3709d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.124378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bbefa9f11b462baa345257b9f3709d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.131606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bbefa9f11b462baa345257b9f3709d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.132753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-60b9bcf2-aa97-4012-b2db-2526fc28f465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bbefa9f11b462baa345257b9f3709d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.245999 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1343/2676] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:56:47 2022] DELETE /identity/v3/users/a5bbefa9f11b462baa345257b9f3709d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:56:48.520335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:48.536349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db111f6-98c0-40b6-bf1b-d164d492bcf1 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:48.611549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:48.612415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:48.612697 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:48.612976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] PATH_INFO: `/v3/projects/5bd95f703d4a4e36a4dfcd8f1257db53` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:48.625383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd95f703d4a4e36a4dfcd8f1257db53)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:48.627407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:48.731003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd95f703d4a4e36a4dfcd8f1257db53', 'request_id': 'req-d2ecea51-3c0c-4130-8998-3b0523eafa19'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.737989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd95f703d4a4e36a4dfcd8f1257db53', 'request_id': 'req-d2ecea51-3c0c-4130-8998-3b0523eafa19'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.744801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd95f703d4a4e36a4dfcd8f1257db53', 'request_id': 'req-d2ecea51-3c0c-4130-8998-3b0523eafa19'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.820284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] The token cache is being invalidate because project 5bd95f703d4a4e36a4dfcd8f1257db53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:56:48.820629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.821727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d2ecea51-3c0c-4130-8998-3b0523eafa19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:48.822942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1334/2677] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:56:48 2022] DELETE /identity/v3/projects/5bd95f703d4a4e36a4dfcd8f1257db53 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:56:48.828030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d93c2-501a-4596-93ee-f9a413195671 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:48.828318 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d93c2-501a-4596-93ee-f9a413195671 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:48.828681 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d93c2-501a-4596-93ee-f9a413195671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:48.847382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-923d93c2-501a-4596-93ee-f9a413195671 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:48.848621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-923d93c2-501a-4596-93ee-f9a413195671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:48.914010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1344/2678] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:48.922333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f88b6d-a66f-408a-871c-f423847d8136 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:48.922631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f88b6d-a66f-408a-871c-f423847d8136 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:48.922907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f88b6d-a66f-408a-871c-f423847d8136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:48.940847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-86f88b6d-a66f-408a-871c-f423847d8136 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:48.942154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-86f88b6d-a66f-408a-871c-f423847d8136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:48.950764 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1335/2679] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:48.955460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d93c2-501a-4596-93ee-f9a413195671 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:48.965553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d93c2-501a-4596-93ee-f9a413195671 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:48.972085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:48.972804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:48.973089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:48.973359 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:48.974126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:56:48.974433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:48.976110 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:48.989074 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1345/2680] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:56:48.993290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f88b6d-a66f-408a-871c-f423847d8136 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:49.003916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f88b6d-a66f-408a-871c-f423847d8136 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:49.008677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:49.009346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:49.009634 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:49.009950 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:49.010656 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:49.012581 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:49.101403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1336/2681] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:56:48 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:56:49.102490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:49.114059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593849-c1a3-443e-8144-869f195625b3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:49.161917 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:49.173792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:49.174700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:49.174993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:49.175278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:49.176004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:49.178040 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:49.297962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1346/2682] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:56:49 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:56:49.302160 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:49.313276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51859a-f4e7-4813-b405-6d08c3f9a6f8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:49.318062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:49.318727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:49.319006 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:49.319277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:49.320257 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:49.321874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:49.332290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1337/2683] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:56:49.336553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:49.347160 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878663fa-7849-4d31-bff3-962b029ef7ce admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:49.351842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f150-921e-477d-b05c-49335ae2b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:49.352430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f150-921e-477d-b05c-49335ae2b130 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:49.352711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f150-921e-477d-b05c-49335ae2b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:49.352989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f150-921e-477d-b05c-49335ae2b130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:49.353741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f150-921e-477d-b05c-49335ae2b130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:49.355430 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f150-921e-477d-b05c-49335ae2b130 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:49.367762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1347/2684] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:56:49.371981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:49.382838 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e626d2-d52b-44ff-8d38-935fb5ab05b2 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:49.387334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:49.388199 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:49.388479 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:49.388751 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] PATH_INFO: `/v3/projects/793143b7edf746fabb18f9add695a351/users/96f89aee789b4e1aae723f71093a0e0c/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:49.404783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793143b7edf746fabb18f9add695a351, user_id=96f89aee789b4e1aae723f71093a0e0c, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:49.408105 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:49.491482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1338/2685] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:56:49 2022] PUT /identity/v3/projects/793143b7edf746fabb18f9add695a351/users/96f89aee789b4e1aae723f71093a0e0c/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:56:49.503100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8d220-9b25-403d-84a0-09d19e56af58 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:49.503402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8d220-9b25-403d-84a0-09d19e56af58 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:49.503686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8d220-9b25-403d-84a0-09d19e56af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:49.533533 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-41c8d220-9b25-403d-84a0-09d19e56af58 None None] MFA Rules not processed for user `96f89aee789b4e1aae723f71093a0e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:49.534807 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-41c8d220-9b25-403d-84a0-09d19e56af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:49.607177 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1348/2686] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:56:49.618858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:49.620738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:49.628612 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:49.700846 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f1f7-94db-4164-9ccd-06aa8eae0453 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:49.708049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165696-2cf4-46fc-8b7c-46546eaa8249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:49.708712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165696-2cf4-46fc-8b7c-46546eaa8249 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:49.708998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165696-2cf4-46fc-8b7c-46546eaa8249 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:49.709278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165696-2cf4-46fc-8b7c-46546eaa8249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:49.717672 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165696-2cf4-46fc-8b7c-46546eaa8249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:49.719527 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165696-2cf4-46fc-8b7c-46546eaa8249 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:49.728947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1339/2687] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 08:56:49.954726 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8d220-9b25-403d-84a0-09d19e56af58 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:50.016503 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8d220-9b25-403d-84a0-09d19e56af58 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:50.021101 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:50.022027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:50.022309 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:50.022583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] PATH_INFO: `/v3/users/96f89aee789b4e1aae723f71093a0e0c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:50.023760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f89aee789b4e1aae723f71093a0e0c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:50.025702 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:50.226468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f89aee789b4e1aae723f71093a0e0c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:50.227055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f89aee789b4e1aae723f71093a0e0c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:50.234822 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:50.239159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f89aee789b4e1aae723f71093a0e0c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:50.246295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f89aee789b4e1aae723f71093a0e0c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:50.246995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f89aee789b4e1aae723f71093a0e0c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:50.330064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1349/2688] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:56:49 2022] DELETE /identity/v3/users/96f89aee789b4e1aae723f71093a0e0c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:56:50.334776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:50.335072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:50.335376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:50.354074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:50.355309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:50.419220 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1340/2689] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:50.429339 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:50.430800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:50.490512 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8b67a-964e-457a-bde7-8e262d66d14a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:50.494064 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f2d99-7e15-4158-a3fa-c1f644c500fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:50.494712 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2d99-7e15-4158-a3fa-c1f644c500fc service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:50.495000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2d99-7e15-4158-a3fa-c1f644c500fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:50.495279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2d99-7e15-4158-a3fa-c1f644c500fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:50.505164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f2d99-7e15-4158-a3fa-c1f644c500fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:50.506667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f2d99-7e15-4158-a3fa-c1f644c500fc service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:50.517348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1350/2690] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:56:50.950323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:50.951932 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:50.964608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5111c-e45e-4802-b20c-3ae3f17f6a06 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:50.969548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:50.970440 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:50.970886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:50.971174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] PATH_INFO: `/v3/projects/793143b7edf746fabb18f9add695a351` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:50.972427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=793143b7edf746fabb18f9add695a351)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:50.974386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:51.141388 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793143b7edf746fabb18f9add695a351', 'request_id': 'req-a40f13f6-2913-4b43-b701-e1c495b437bc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:51.147399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793143b7edf746fabb18f9add695a351', 'request_id': 'req-a40f13f6-2913-4b43-b701-e1c495b437bc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:51.153971 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793143b7edf746fabb18f9add695a351', 'request_id': 'req-a40f13f6-2913-4b43-b701-e1c495b437bc'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:51.243351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] The token cache is being invalidate because project 793143b7edf746fabb18f9add695a351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:56:51.243643 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:51.244289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a40f13f6-2913-4b43-b701-e1c495b437bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:51.246003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1341/2691] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:56:50 2022] DELETE /identity/v3/projects/793143b7edf746fabb18f9add695a351 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:56:51.252194 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41f935-5f9c-41e6-b716-f9cd59ebbd94 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.252865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41f935-5f9c-41e6-b716-f9cd59ebbd94 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.252865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41f935-5f9c-41e6-b716-f9cd59ebbd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.270842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ab41f935-5f9c-41e6-b716-f9cd59ebbd94 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:51.272041 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ab41f935-5f9c-41e6-b716-f9cd59ebbd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:51.336980 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1351/2692] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:51.345289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446378-760c-4ae7-ae50-0db0e68e3e42 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.345638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446378-760c-4ae7-ae50-0db0e68e3e42 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.345889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446378-760c-4ae7-ae50-0db0e68e3e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.366986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-64446378-760c-4ae7-ae50-0db0e68e3e42 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:51.368563 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-64446378-760c-4ae7-ae50-0db0e68e3e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:51.378407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1342/2693] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:51.383350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41f935-5f9c-41e6-b716-f9cd59ebbd94 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:51.393888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41f935-5f9c-41e6-b716-f9cd59ebbd94 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:51.399789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:51.400472 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.400760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.401043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.401885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:56:51.402130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:51.404432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:51.417842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1352/2694] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:56:51.422925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64446378-760c-4ae7-ae50-0db0e68e3e42 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:51.432430 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64446378-760c-4ae7-ae50-0db0e68e3e42 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:51.437396 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:51.439123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.439123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.439123 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.439464 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:51.441461 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:51.445103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:51.544554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1343/2695] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:56:51 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:56:51.549017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:51.559474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076ad5-365e-4c2d-8f0e-a2ab682de92e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:51.619881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:51.620573 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.620837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.621114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.621848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:51.623783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:51.633956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:51.737667 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1353/2696] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:56:51 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:56:51.741821 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:51.752617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8ebf6-fedf-4595-a741-7e7aa9ba2396 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:51.757344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:51.758084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.758377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.758652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.759382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:51.760999 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:51.771939 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1344/2697] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:56:51.776120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:51.787247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e7c1-d75f-4734-9d50-3af6919e5e21 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:51.792186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b2ac5-9009-4b38-a9a6-c3e89fbe6e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:51.792792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b2ac5-9009-4b38-a9a6-c3e89fbe6e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.793501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b2ac5-9009-4b38-a9a6-c3e89fbe6e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.793501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b2ac5-9009-4b38-a9a6-c3e89fbe6e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.794222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b2ac5-9009-4b38-a9a6-c3e89fbe6e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:51.796045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b2ac5-9009-4b38-a9a6-c3e89fbe6e39 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:51.807979 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1354/2698] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:56:51.812017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:51.822738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3311f6e-cc7f-453f-a9ec-98dbbd718e86 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:51.827947 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:51.828837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.829125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.829405 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] PATH_INFO: `/v3/projects/aa7307c3f5174d56a0c56ba96886b5e3/users/59499d714fcd4a1682c4a8c79a914ddd/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.845317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7307c3f5174d56a0c56ba96886b5e3, user_id=59499d714fcd4a1682c4a8c79a914ddd, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:51.848071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:51.932930 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1345/2699] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:56:51 2022] PUT /identity/v3/projects/aa7307c3f5174d56a0c56ba96886b5e3/users/59499d714fcd4a1682c4a8c79a914ddd/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:56:51.944332 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d128d86-8749-4e8e-a876-346420336e77 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:51.944925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d128d86-8749-4e8e-a876-346420336e77 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:51.945214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d128d86-8749-4e8e-a876-346420336e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:51.975062 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5d128d86-8749-4e8e-a876-346420336e77 None None] MFA Rules not processed for user `59499d714fcd4a1682c4a8c79a914ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:51.976292 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5d128d86-8749-4e8e-a876-346420336e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:52.046983 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1355/2700] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:52.051782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:52.114754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1e66-e0dd-4bdf-b755-9ec16283647c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:52.119480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:52.124560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.124560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.124560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.124560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:52.124560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:52.247068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1346/2701] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:56:52 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:56:52.251941 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d128d86-8749-4e8e-a876-346420336e77 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:52.262626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d128d86-8749-4e8e-a876-346420336e77 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:52.320972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:52.321563 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.321888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.322168 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.322878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:52.324833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:52.429775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1356/2702] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:56:52 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:56:52.433868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:52.446252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959bea4-640a-45e6-896d-b9e03879cb6e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:52.451237 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:52.455436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.455436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.455436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.455436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:52.455436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:52.467180 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1347/2703] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:56:52.471528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:52.482104 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9134ca-68e1-43e7-9cdf-79b21464db95 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:52.487406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:52.488311 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.488596 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.488875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] PATH_INFO: `/v3/projects/caf1761674fd47098b83984aec6ef998/users/073d9242a707464bb6a6260ff3e0856c/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.505340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf1761674fd47098b83984aec6ef998, user_id=073d9242a707464bb6a6260ff3e0856c, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:52.508180 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:52.584065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1357/2704] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:56:52 2022] PUT /identity/v3/projects/caf1761674fd47098b83984aec6ef998/users/073d9242a707464bb6a6260ff3e0856c/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:56:52.588064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:52.598953 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7023684-4f13-48e2-aefd-fd17cf1c75df admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:52.659525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e55af7-a994-4114-b363-42c3f4e45300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:52.660206 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55af7-a994-4114-b363-42c3f4e45300 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.660494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55af7-a994-4114-b363-42c3f4e45300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.660775 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55af7-a994-4114-b363-42c3f4e45300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.661548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e55af7-a994-4114-b363-42c3f4e45300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:52.663213 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e55af7-a994-4114-b363-42c3f4e45300 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:52.675804 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1348/2705] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:56:52.680355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:52.691912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb513c7-c1e7-42fa-9c9a-b0fd484cd779 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:52.697097 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:52.698054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.698340 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.698618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] PATH_INFO: `/v3/projects/caf1761674fd47098b83984aec6ef998/users/073d9242a707464bb6a6260ff3e0856c/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.700660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf1761674fd47098b83984aec6ef998, user_id=073d9242a707464bb6a6260ff3e0856c, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:52.703699 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:52.716270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1358/2706] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:56:52 2022] PUT /identity/v3/projects/caf1761674fd47098b83984aec6ef998/users/073d9242a707464bb6a6260ff3e0856c/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:56:52.728646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.735981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.735981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.757054 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] MFA Rules not processed for user `073d9242a707464bb6a6260ff3e0856c`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:52.758358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:52.766928 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:52.827886 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1349/2707] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:52.839790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:52.841476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:52.876554 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:52.904815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df820-74db-4a45-8719-f341469a40e7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:52.910254 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:52.910922 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:52.911211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:52.911493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:52.971007 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:52.972445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:52.981371 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1359/2708] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:56:54.728544 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:54.730168 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:54.743310 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14470305-1a9b-4cc2-9c4d-e061978889af None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:54.746998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1183de-7a38-4926-b544-0f3482724d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:54.747734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1183de-7a38-4926-b544-0f3482724d89 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:54.747920 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1183de-7a38-4926-b544-0f3482724d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:54.748197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1183de-7a38-4926-b544-0f3482724d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:54.758691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1183de-7a38-4926-b544-0f3482724d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:54.760149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1183de-7a38-4926-b544-0f3482724d89 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:54.770046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1350/2709] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:56:59.199402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:59.262362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf1bff-4e0f-4183-947c-25eaf24e9831 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:59.267089 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:59.267959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:59.268239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:59.269127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] PATH_INFO: `/v3/users/59499d714fcd4a1682c4a8c79a914ddd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:59.270383 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59499d714fcd4a1682c4a8c79a914ddd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:59.272300 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:59.420059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59499d714fcd4a1682c4a8c79a914ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:59.420670 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59499d714fcd4a1682c4a8c79a914ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:59.433181 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59499d714fcd4a1682c4a8c79a914ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:59.441026 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59499d714fcd4a1682c4a8c79a914ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:59.441848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59499d714fcd4a1682c4a8c79a914ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:56:59.531170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:59.535696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1360/2710] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:56:59 2022] DELETE /identity/v3/users/59499d714fcd4a1682c4a8c79a914ddd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:56:59.540489 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:59.540992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:59.541126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:59.560338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:56:59.561567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:59.629731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1351/2711] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:56:59.639769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:56:59.641193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:56:59.700622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b835-9c51-4046-9aa7-f2295956ec3a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:56:59.704299 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:56:59.704952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:56:59.705239 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:56:59.705555 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:56:59.715549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:56:59.717032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:56:59.726851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1361/2712] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:00.144609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:00.146431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:00.161784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6bc6-c83d-4f6c-a167-d6e730570d66 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:00.166595 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:00.169313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:00.169313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:00.169313 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] PATH_INFO: `/v3/projects/aa7307c3f5174d56a0c56ba96886b5e3` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:00.169647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7307c3f5174d56a0c56ba96886b5e3)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:00.171568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:00.309536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7307c3f5174d56a0c56ba96886b5e3', 'request_id': 'req-dfa355f7-85e0-454c-9d15-8f6e58213630'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.315182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7307c3f5174d56a0c56ba96886b5e3', 'request_id': 'req-dfa355f7-85e0-454c-9d15-8f6e58213630'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.322759 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7307c3f5174d56a0c56ba96886b5e3', 'request_id': 'req-dfa355f7-85e0-454c-9d15-8f6e58213630'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.369776 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] The token cache is being invalidate because project aa7307c3f5174d56a0c56ba96886b5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:57:00.370070 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.370711 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.372270 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1352/2713] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:57:00 2022] DELETE /identity/v3/projects/aa7307c3f5174d56a0c56ba96886b5e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:00.376251 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:00.387871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91752-1848-4d5c-b561-438914f7357f service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:00.445522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:00.446543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:00.446825 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:00.447098 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] PATH_INFO: `/v3/users/073d9242a707464bb6a6260ff3e0856c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:00.448307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073d9242a707464bb6a6260ff3e0856c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:00.450258 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:00.617636 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073d9242a707464bb6a6260ff3e0856c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.618243 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073d9242a707464bb6a6260ff3e0856c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.630793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073d9242a707464bb6a6260ff3e0856c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.637727 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073d9242a707464bb6a6260ff3e0856c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.638441 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3cea9158-9376-41b1-9bf0-3e8596bed374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073d9242a707464bb6a6260ff3e0856c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:00.719390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1362/2714] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:57:00 2022] DELETE /identity/v3/users/073d9242a707464bb6a6260ff3e0856c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:01.127080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:01.128614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:01.142268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa355f7-85e0-454c-9d15-8f6e58213630 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:01.157066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:01.205161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:01.206631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.207038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.207346 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] PATH_INFO: `/v3/projects/caf1761674fd47098b83984aec6ef998` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.208567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf1761674fd47098b83984aec6ef998)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:01.211442 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:01.318547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf1761674fd47098b83984aec6ef998', 'request_id': 'req-e304ced2-79b4-48dc-bc44-e0cc029ca877'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:01.324409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf1761674fd47098b83984aec6ef998', 'request_id': 'req-e304ced2-79b4-48dc-bc44-e0cc029ca877'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:01.330858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf1761674fd47098b83984aec6ef998', 'request_id': 'req-e304ced2-79b4-48dc-bc44-e0cc029ca877'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:01.404709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] The token cache is being invalidate because project caf1761674fd47098b83984aec6ef998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:57:01.404931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:01.405520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-e304ced2-79b4-48dc-bc44-e0cc029ca877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:01.407108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1353/2715] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:57:01 2022] DELETE /identity/v3/projects/caf1761674fd47098b83984aec6ef998 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:01.412900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa358-a54a-4a46-9bd2-f797176a933b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.413537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa358-a54a-4a46-9bd2-f797176a933b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.413856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa358-a54a-4a46-9bd2-f797176a933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.431827 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ec5aa358-a54a-4a46-9bd2-f797176a933b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:01.433044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ec5aa358-a54a-4a46-9bd2-f797176a933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:01.451538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:01.496334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1363/2716] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:01.505002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d218ea-5ee2-4045-a271-3889f96d00e2 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.505298 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d218ea-5ee2-4045-a271-3889f96d00e2 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.505608 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d218ea-5ee2-4045-a271-3889f96d00e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.526628 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c7d218ea-5ee2-4045-a271-3889f96d00e2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:01.527870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c7d218ea-5ee2-4045-a271-3889f96d00e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:01.537516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1354/2717] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:01.542668 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa358-a54a-4a46-9bd2-f797176a933b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:01.555839 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa358-a54a-4a46-9bd2-f797176a933b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:01.560852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:01.561530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.561842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.562122 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.562861 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:57:01.563234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:01.564863 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:01.580137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1364/2718] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:57:01.586375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d218ea-5ee2-4045-a271-3889f96d00e2 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:01.596352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d218ea-5ee2-4045-a271-3889f96d00e2 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:01.601569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:01.602279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.602629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.602911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.603613 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:01.605532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:01.699404 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1355/2719] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:57:01 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:57:01.708536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:01.718972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74bf1-9dce-49a2-896b-925ac6ee1b5d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:01.778561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:01.779234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.779523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.779803 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.780522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:01.782509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:01.860514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1365/2720] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:57:01 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:57:01.865528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:01.876265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e7198-45ca-47bd-92dd-784a7b950e44 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:01.881540 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:01.882227 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.882509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.882784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.883515 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:01.885107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:01.895689 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1356/2721] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:57:01.899792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:01.910643 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d017-d800-469c-8a15-d0f1c31d75af admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:01.915211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bc926-ab59-485c-847c-ff0e5178c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:01.915864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bc926-ab59-485c-847c-ff0e5178c35c admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.916148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bc926-ab59-485c-847c-ff0e5178c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.916419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bc926-ab59-485c-847c-ff0e5178c35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.917136 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bc926-ab59-485c-847c-ff0e5178c35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:01.918771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bc926-ab59-485c-847c-ff0e5178c35c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:01.928713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1366/2722] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:57:01.932981 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:01.942944 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f1227-58b3-4831-a6d9-70dd40593976 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:01.947990 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:01.948859 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:01.949140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:01.949467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] PATH_INFO: `/v3/projects/dd83fc07fd7a4cc29d3fd781d52c8aee/users/c1f869961cad4e048eba96b0b00b4829/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:01.965578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd83fc07fd7a4cc29d3fd781d52c8aee, user_id=c1f869961cad4e048eba96b0b00b4829, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:01.968284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:02.074460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1357/2723] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:57:01 2022] PUT /identity/v3/projects/dd83fc07fd7a4cc29d3fd781d52c8aee/users/c1f869961cad4e048eba96b0b00b4829/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:02.086047 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111d1b4-270f-4d2c-ac27-f3770e8c30a0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:02.086342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111d1b4-270f-4d2c-ac27-f3770e8c30a0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:02.086626 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111d1b4-270f-4d2c-ac27-f3770e8c30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:02.115504 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1111d1b4-270f-4d2c-ac27-f3770e8c30a0 None None] MFA Rules not processed for user `c1f869961cad4e048eba96b0b00b4829`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:02.116779 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1111d1b4-270f-4d2c-ac27-f3770e8c30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:02.183262 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1367/2724] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:57:02.195209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:02.197033 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:02.244967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:02.258141 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343feecc-b6fb-44d7-be71-a2982a96515e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:02.262321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a7256-9dc1-4f01-92fc-a02056424eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:02.262987 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7256-9dc1-4f01-92fc-a02056424eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:02.263277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7256-9dc1-4f01-92fc-a02056424eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:02.263558 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7256-9dc1-4f01-92fc-a02056424eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:02.279678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a7256-9dc1-4f01-92fc-a02056424eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:02.279678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a7256-9dc1-4f01-92fc-a02056424eb4 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:02.287793 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1358/2725] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:02.308111 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111d1b4-270f-4d2c-ac27-f3770e8c30a0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:02.329538 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:02.374828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111d1b4-270f-4d2c-ac27-f3770e8c30a0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:02.381302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:02.382236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:02.382518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:02.382792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] PATH_INFO: `/v3/users/c1f869961cad4e048eba96b0b00b4829` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:02.384005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f869961cad4e048eba96b0b00b4829)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:02.385972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:02.567310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f869961cad4e048eba96b0b00b4829'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:02.568000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f869961cad4e048eba96b0b00b4829'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:02.580758 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f869961cad4e048eba96b0b00b4829'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:02.588419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f869961cad4e048eba96b0b00b4829'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:02.589279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f869961cad4e048eba96b0b00b4829'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:02.702813 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1368/2726] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:57:02 2022] DELETE /identity/v3/users/c1f869961cad4e048eba96b0b00b4829 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:02.708238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:02.712366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:02.712366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:02.726878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:02.728073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:02.787750 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1359/2727] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:02.797846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:02.799298 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:02.859442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d54ff-2329-4f11-97b6-a01a4a4738ac admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:02.863378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c8e31-613d-4f6d-abe3-3312a4693c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:02.864034 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8e31-613d-4f6d-abe3-3312a4693c9f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:02.864321 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8e31-613d-4f6d-abe3-3312a4693c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:02.864601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8e31-613d-4f6d-abe3-3312a4693c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:02.873959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c8e31-613d-4f6d-abe3-3312a4693c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:02.875488 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c8e31-613d-4f6d-abe3-3312a4693c9f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:02.885666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1369/2728] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:03.295911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:03.297385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:03.310774 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed12b2-b829-4a9e-b88e-ef740f173308 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:03.316357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:03.316771 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:03.317125 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:03.317352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] PATH_INFO: `/v3/projects/dd83fc07fd7a4cc29d3fd781d52c8aee` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:03.318602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd83fc07fd7a4cc29d3fd781d52c8aee)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:03.321026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:03.439867 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd83fc07fd7a4cc29d3fd781d52c8aee', 'request_id': 'req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:03.445833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd83fc07fd7a4cc29d3fd781d52c8aee', 'request_id': 'req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:03.451959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd83fc07fd7a4cc29d3fd781d52c8aee', 'request_id': 'req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:03.526062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] The token cache is being invalidate because project dd83fc07fd7a4cc29d3fd781d52c8aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:57:03.526062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:03.526482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-f31e3e24-88a1-4c72-a196-a6f4ceb35d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:03.528092 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1360/2729] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:57:03 2022] DELETE /identity/v3/projects/dd83fc07fd7a4cc29d3fd781d52c8aee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:03.533028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e41d-764e-44bf-a087-465f220c5727 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:03.533283 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e41d-764e-44bf-a087-465f220c5727 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:03.533577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e41d-764e-44bf-a087-465f220c5727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:03.553960 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-af38e41d-764e-44bf-a087-465f220c5727 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:03.555102 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-af38e41d-764e-44bf-a087-465f220c5727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:03.588924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:03.615417 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1370/2730] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:03.624375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f16a-0e24-470d-afd3-3e10af992ebc None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:03.626184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f16a-0e24-470d-afd3-3e10af992ebc None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:03.626184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f16a-0e24-470d-afd3-3e10af992ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:03.644946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-6af8f16a-0e24-470d-afd3-3e10af992ebc None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:03.646225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-6af8f16a-0e24-470d-afd3-3e10af992ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:03.654641 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1361/2731] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:03.659072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e41d-764e-44bf-a087-465f220c5727 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:03.669325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e41d-764e-44bf-a087-465f220c5727 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:03.674157 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:03.674832 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:03.675146 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:03.675470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:03.676286 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:57:03.676791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:03.678737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:03.690942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1371/2732] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:57:03.695731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f16a-0e24-470d-afd3-3e10af992ebc None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:03.705104 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f16a-0e24-470d-afd3-3e10af992ebc None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:03.710633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:03.711291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:03.711575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:03.711851 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:03.712560 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:03.714529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:03.807786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1362/2733] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:57:03 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 08:57:03.811737 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:03.823013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38d52-73e6-4351-88cf-b37caba1e863 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:03.881236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:03.881973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:03.882260 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:03.882542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:03.883228 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:03.885150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:03.960130 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1372/2734] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:57:03 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:57:03.964249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:03.975537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e7530-6563-4905-8922-670d20d64544 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:03.980333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:03.981002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:03.981289 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:03.981569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:03.982334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:03.983929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:03.995786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1363/2735] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:57:03.999731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:04.011115 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec3c7c-4222-44fb-8768-3342feba7b97 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:04.015907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe749-50ac-4bfe-88e5-f9284b03e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:04.016564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe749-50ac-4bfe-88e5-f9284b03e184 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:04.016848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe749-50ac-4bfe-88e5-f9284b03e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:04.017123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe749-50ac-4bfe-88e5-f9284b03e184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:04.017888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfe749-50ac-4bfe-88e5-f9284b03e184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:04.020164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfe749-50ac-4bfe-88e5-f9284b03e184 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:04.030798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1373/2736] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:57:04.035523 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:04.047700 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18169e60-0977-48e4-b0aa-b1a7494d4b2b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:04.052854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:04.053767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:04.054055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:04.054332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] PATH_INFO: `/v3/projects/1b33d432835d462394b7ef4a6e5611f5/users/a1ac591be57a48c8b6bcf4dd7bd5e048/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:04.070216 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b33d432835d462394b7ef4a6e5611f5, user_id=a1ac591be57a48c8b6bcf4dd7bd5e048, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:04.072809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:04.171341 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1364/2737] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:57:04 2022] PUT /identity/v3/projects/1b33d432835d462394b7ef4a6e5611f5/users/a1ac591be57a48c8b6bcf4dd7bd5e048/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:04.182498 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:04.182798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:04.183083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:04.210511 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] MFA Rules not processed for user `a1ac591be57a48c8b6bcf4dd7bd5e048`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:04.211741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:04.276764 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1374/2738] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:04.288376 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:04.290134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:04.296588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:04.351378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac4e1-071b-45a9-bee2-6620249d48fc admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:04.355041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:04.355685 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:04.355967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:04.356239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:04.365212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:04.366736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:04.375760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1365/2739] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:12.769059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:12.770606 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:12.812915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:12.831968 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab864172-1303-4fbc-bb7f-27891ddc248e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:12.835996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19de69-8a9d-4b56-9c26-1c52235fc7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:12.845731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19de69-8a9d-4b56-9c26-1c52235fc7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:12.845731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19de69-8a9d-4b56-9c26-1c52235fc7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:12.845731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19de69-8a9d-4b56-9c26-1c52235fc7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:12.845731 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ad19de69-8a9d-4b56-9c26-1c52235fc7e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:12.850301 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19de69-8a9d-4b56-9c26-1c52235fc7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:12.851773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19de69-8a9d-4b56-9c26-1c52235fc7e8 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:12.860611 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1375/2740] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:14.473777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=24 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:22.941962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=10 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:25.753591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:25.817365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01701db-4b4e-412b-8c2a-0db73917505e service glance] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:25.822378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:25.823247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:25.823533 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:25.823808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] PATH_INFO: `/v3/users/a1ac591be57a48c8b6bcf4dd7bd5e048` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:25.825015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ac591be57a48c8b6bcf4dd7bd5e048)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:25.827169 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:26.025236 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ac591be57a48c8b6bcf4dd7bd5e048'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.026599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ac591be57a48c8b6bcf4dd7bd5e048'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.038709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ac591be57a48c8b6bcf4dd7bd5e048'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.045582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ac591be57a48c8b6bcf4dd7bd5e048'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.046266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ac591be57a48c8b6bcf4dd7bd5e048'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.108089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1366/2741] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:57:25 2022] DELETE /identity/v3/users/a1ac591be57a48c8b6bcf4dd7bd5e048 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 08:57:26.112691 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:26.113167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:26.113268 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:26.133341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:26.136070 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:26.199334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1376/2742] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:26.209493 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:26.210979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:26.271411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7a3ed-7924-44d1-a775-2e3c8195e93d admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:26.275366 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7b6ca-b927-4441-990a-bca0f0cdb488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:26.276071 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b6ca-b927-4441-990a-bca0f0cdb488 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:26.276516 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b6ca-b927-4441-990a-bca0f0cdb488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:26.276801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7b6ca-b927-4441-990a-bca0f0cdb488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:26.286393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7b6ca-b927-4441-990a-bca0f0cdb488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:26.287839 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7b6ca-b927-4441-990a-bca0f0cdb488 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:26.298323 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1367/2743] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:26.726442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:26.727865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:26.740864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0851-4afa-41e5-96e1-41ec5a4bf416 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:26.745828 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:26.746728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:26.747013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:26.747285 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] PATH_INFO: `/v3/projects/1b33d432835d462394b7ef4a6e5611f5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:26.748473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b33d432835d462394b7ef4a6e5611f5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:26.750490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:26.873655 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b33d432835d462394b7ef4a6e5611f5', 'request_id': 'req-43cf47c9-569e-4071-8f49-63b1c0e89290'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.947717 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b33d432835d462394b7ef4a6e5611f5', 'request_id': 'req-43cf47c9-569e-4071-8f49-63b1c0e89290'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.954247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b33d432835d462394b7ef4a6e5611f5', 'request_id': 'req-43cf47c9-569e-4071-8f49-63b1c0e89290'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.966167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] The token cache is being invalidate because project 1b33d432835d462394b7ef4a6e5611f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:57:26.966835 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.967116 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-43cf47c9-569e-4071-8f49-63b1c0e89290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:26.968661 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1377/2744] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:57:26 2022] DELETE /identity/v3/projects/1b33d432835d462394b7ef4a6e5611f5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:26.974022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fda9c-cfd9-4665-9868-85436ca9606c None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:26.974521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fda9c-cfd9-4665-9868-85436ca9606c None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:26.974521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fda9c-cfd9-4665-9868-85436ca9606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:26.992965 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-4b1fda9c-cfd9-4665-9868-85436ca9606c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:26.994321 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-4b1fda9c-cfd9-4665-9868-85436ca9606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:27.012334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:27.057466 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1368/2745] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:27.066795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f834e-34cc-4bfb-8b0d-41143c0a424d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.067091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f834e-34cc-4bfb-8b0d-41143c0a424d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.067373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f834e-34cc-4bfb-8b0d-41143c0a424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.086143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6d0f834e-34cc-4bfb-8b0d-41143c0a424d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:27.087516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6d0f834e-34cc-4bfb-8b0d-41143c0a424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:27.096330 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1378/2746] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:27.100822 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fda9c-cfd9-4665-9868-85436ca9606c None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:27.111609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fda9c-cfd9-4665-9868-85436ca9606c None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:27.116320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:27.116978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.117268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.117706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.118367 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:57:27.118673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:27.120363 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:27.136371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1369/2747] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:57:27.140919 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f834e-34cc-4bfb-8b0d-41143c0a424d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:27.151397 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f834e-34cc-4bfb-8b0d-41143c0a424d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:27.156185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:27.156851 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.157195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.157476 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.158308 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:27.160246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:27.401499 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1379/2748] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:57:27 2022] POST /identity/v3/projects => generated 361 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:57:27.405986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:27.416564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375c48-8b61-482a-8204-77b42bfafe48 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:27.477156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:27.477863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.478152 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.478436 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.479175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:27.481188 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:27.582986 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1370/2749] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:57:27 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:57:27.587282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:27.598234 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c0f1a-b76a-4670-9163-8ffc8af61c9d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:27.602896 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:27.608757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.608757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.608757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.608757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:27.608757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:27.617921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1380/2750] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 08:57:27.622706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:27.632860 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36a6ce-0b5d-48f3-8f9a-eb1d842636a3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:27.638153 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30591c-e54c-4052-8c09-15324863871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:27.638825 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30591c-e54c-4052-8c09-15324863871c admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.639134 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30591c-e54c-4052-8c09-15324863871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.639414 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30591c-e54c-4052-8c09-15324863871c admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.640145 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30591c-e54c-4052-8c09-15324863871c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:27.641770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30591c-e54c-4052-8c09-15324863871c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:27.652187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1371/2751] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:57:27.656494 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:27.667947 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17dd15-1acc-4260-baac-98730fa60761 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:27.677374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:27.677374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.677374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.677374 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] PATH_INFO: `/v3/projects/4d46e8d104594e7aaa56e7933d474bec/users/da9d323a89834834993754a90ca45f9c/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.690364 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d46e8d104594e7aaa56e7933d474bec, user_id=da9d323a89834834993754a90ca45f9c, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:27.693012 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:27.758882 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1381/2752] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:57:27 2022] PUT /identity/v3/projects/4d46e8d104594e7aaa56e7933d474bec/users/da9d323a89834834993754a90ca45f9c/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:27.769989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c6e24-fb33-4ecd-a170-8eea97895e95 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.770291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c6e24-fb33-4ecd-a170-8eea97895e95 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.770570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c6e24-fb33-4ecd-a170-8eea97895e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.796917 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-e49c6e24-fb33-4ecd-a170-8eea97895e95 None None] MFA Rules not processed for user `da9d323a89834834993754a90ca45f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:27.798176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e49c6e24-fb33-4ecd-a170-8eea97895e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:27.863786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1372/2753] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:27.895490 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:27.897220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:27.919753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:27.954680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357adf3-dc10-46b6-8ebb-621db2059b88 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:27.958356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb105-d749-41fe-9cfd-c3fa059c7e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:27.958993 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb105-d749-41fe-9cfd-c3fa059c7e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:27.959277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb105-d749-41fe-9cfd-c3fa059c7e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:27.959552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb105-d749-41fe-9cfd-c3fa059c7e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:27.968302 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb105-d749-41fe-9cfd-c3fa059c7e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:27.969801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb105-d749-41fe-9cfd-c3fa059c7e0e service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:27.979162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1382/2754] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:27.993191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c6e24-fb33-4ecd-a170-8eea97895e95 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:28.014413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:28.059301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c6e24-fb33-4ecd-a170-8eea97895e95 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:28.064040 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:28.064914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:28.065198 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:28.065475 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] PATH_INFO: `/v3/users/da9d323a89834834993754a90ca45f9c` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:28.067074 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9d323a89834834993754a90ca45f9c)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:28.070184 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:28.282654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9d323a89834834993754a90ca45f9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:28.283407 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9d323a89834834993754a90ca45f9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:28.296925 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9d323a89834834993754a90ca45f9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:28.303974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9d323a89834834993754a90ca45f9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:28.304709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9d323a89834834993754a90ca45f9c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:28.382017 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1373/2755] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:57:27 2022] DELETE /identity/v3/users/da9d323a89834834993754a90ca45f9c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:28.386753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:28.387248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:28.387907 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:28.405068 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:28.410372 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:28.467291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1383/2756] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:28.479597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:28.481072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:28.545146 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c598db-8a18-411a-8d82-a45d71f2ac24 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:28.548994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd7098-e418-43c5-ac89-609669615858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:28.549651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7098-e418-43c5-ac89-609669615858 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:28.549969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7098-e418-43c5-ac89-609669615858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:28.550243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7098-e418-43c5-ac89-609669615858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:28.560231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd7098-e418-43c5-ac89-609669615858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:28.561701 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd7098-e418-43c5-ac89-609669615858 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:28.571719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1374/2757] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:28.998795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:29.000317 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:29.014988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5885-6382-4bf8-9ac6-1ef118d94554 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:29.020000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:29.020878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.021170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.021453 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] PATH_INFO: `/v3/projects/4d46e8d104594e7aaa56e7933d474bec` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.022696 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d46e8d104594e7aaa56e7933d474bec)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:29.024742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:29.158380 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d46e8d104594e7aaa56e7933d474bec', 'request_id': 'req-28f56017-e84a-48f1-93f2-2193c9da7837'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:29.259680 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d46e8d104594e7aaa56e7933d474bec', 'request_id': 'req-28f56017-e84a-48f1-93f2-2193c9da7837'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:29.266837 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d46e8d104594e7aaa56e7933d474bec', 'request_id': 'req-28f56017-e84a-48f1-93f2-2193c9da7837'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:29.278185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] The token cache is being invalidate because project 4d46e8d104594e7aaa56e7933d474bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:57:29.278516 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:29.279166 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-28f56017-e84a-48f1-93f2-2193c9da7837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:29.280708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1384/2758] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:57:28 2022] DELETE /identity/v3/projects/4d46e8d104594e7aaa56e7933d474bec => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:29.285633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a12b-3840-4456-84eb-eadf2d602978 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.286230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a12b-3840-4456-84eb-eadf2d602978 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.286230 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a12b-3840-4456-84eb-eadf2d602978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.304647 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d6e8a12b-3840-4456-84eb-eadf2d602978 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:29.306524 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d6e8a12b-3840-4456-84eb-eadf2d602978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:29.340777 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:29.367663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1375/2759] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:29.376119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02c728-3844-40f6-8d2d-03c6f300c7f4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.381238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02c728-3844-40f6-8d2d-03c6f300c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.381238 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02c728-3844-40f6-8d2d-03c6f300c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.396282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7c02c728-3844-40f6-8d2d-03c6f300c7f4 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:29.397568 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7c02c728-3844-40f6-8d2d-03c6f300c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:29.405911 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1385/2760] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:29.417520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a12b-3840-4456-84eb-eadf2d602978 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:29.427633 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a12b-3840-4456-84eb-eadf2d602978 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:29.432335 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:29.433714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.434008 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.434318 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.435055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 08:57:29.435385 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:29.437016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:29.449532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1376/2761] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 08:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 08:57:29.453962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02c728-3844-40f6-8d2d-03c6f300c7f4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:29.463349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02c728-3844-40f6-8d2d-03c6f300c7f4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:29.468276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:29.468927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.469212 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.469491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.470342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:29.472248 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:29.552617 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1386/2762] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 08:57:29 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:57:29.557635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:29.565868 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1408-ead7-4fb1-990e-ac44f87f66d6 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:29.630086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:29.630753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.631038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.631317 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.632058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:29.634174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:29.771108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1377/2763] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 08:57:29 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 08:57:29.775029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:29.785966 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de226d-ff1c-413c-8a8f-831ddac2cb46 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:29.790856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:29.791541 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.791974 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.792704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.793462 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:29.795135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:29.805728 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1387/2764] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:57:29.810599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:29.821095 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0b019-be34-4e3b-848e-fa3ab5fdbe36 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:29.826409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27522a25-0e36-4a23-8fc8-305deb11eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:29.827072 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27522a25-0e36-4a23-8fc8-305deb11eb01 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.827362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27522a25-0e36-4a23-8fc8-305deb11eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.827644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27522a25-0e36-4a23-8fc8-305deb11eb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.828380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27522a25-0e36-4a23-8fc8-305deb11eb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:29.830022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27522a25-0e36-4a23-8fc8-305deb11eb01 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:29.841535 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1378/2765] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 08:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 08:57:29.845963 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:29.856848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07913e44-d877-4f6f-900d-f8a2cd969b83 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:29.861621 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:29.862518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.862800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.863076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] PATH_INFO: `/v3/projects/314b6396998a4ae68c6d01a80bb61df5/users/c67d6c2171264c5cb0445327ca50666d/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:29.865356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:29.878883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=314b6396998a4ae68c6d01a80bb61df5, user_id=c67d6c2171264c5cb0445327ca50666d, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:29.881544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:29.982500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1388/2766] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 08:57:29 2022] PUT /identity/v3/projects/314b6396998a4ae68c6d01a80bb61df5/users/c67d6c2171264c5cb0445327ca50666d/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:29.994194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24634-cf41-48e0-a0b3-7b3c0e1ebc11 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:29.994536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24634-cf41-48e0-a0b3-7b3c0e1ebc11 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:29.994828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24634-cf41-48e0-a0b3-7b3c0e1ebc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:30.023127 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-1bb24634-cf41-48e0-a0b3-7b3c0e1ebc11 None None] MFA Rules not processed for user `c67d6c2171264c5cb0445327ca50666d`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:30.024291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1bb24634-cf41-48e0-a0b3-7b3c0e1ebc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:30.091625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1379/2767] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:30.103686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:30.105790 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:30.163484 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9247e22-9635-4d92-8199-7d98a8141c0c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:30.168024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e555cb6-f666-4d9b-99c8-e431412ff2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:30.168864 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555cb6-f666-4d9b-99c8-e431412ff2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:30.169152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555cb6-f666-4d9b-99c8-e431412ff2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:30.169433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555cb6-f666-4d9b-99c8-e431412ff2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:30.179032 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e555cb6-f666-4d9b-99c8-e431412ff2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:30.180714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e555cb6-f666-4d9b-99c8-e431412ff2d9 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:30.191119 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1389/2768] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:40.088393 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:40.186708 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:48.569758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb24634-cf41-48e0-a0b3-7b3c0e1ebc11 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:48.641248 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb24634-cf41-48e0-a0b3-7b3c0e1ebc11 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:48.648340 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:48.649243 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:48.649526 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:48.649844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] PATH_INFO: `/v3/users/c67d6c2171264c5cb0445327ca50666d` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:48.651101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67d6c2171264c5cb0445327ca50666d)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:48.653096 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:48.870332 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67d6c2171264c5cb0445327ca50666d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:48.871635 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67d6c2171264c5cb0445327ca50666d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:48.887370 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67d6c2171264c5cb0445327ca50666d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:48.896249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67d6c2171264c5cb0445327ca50666d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:48.897792 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67d6c2171264c5cb0445327ca50666d'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:48.987785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1380/2769] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:57:48 2022] DELETE /identity/v3/users/c67d6c2171264c5cb0445327ca50666d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:48.994584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:48.995120 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:48.995253 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:49.014551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:49.015950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:49.079572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1390/2770] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:57:49.090456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:49.091906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:49.164131 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7906c-ec86-43eb-bccc-5f2ec45e9451 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:49.171076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f823c-aaf6-42a0-aeb6-b3200720fb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:49.171760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f823c-aaf6-42a0-aeb6-b3200720fb4f service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:49.172103 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f823c-aaf6-42a0-aeb6-b3200720fb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:49.172387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f823c-aaf6-42a0-aeb6-b3200720fb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:49.184587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f823c-aaf6-42a0-aeb6-b3200720fb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:49.186186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f823c-aaf6-42a0-aeb6-b3200720fb4f service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:49.198176 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1381/2771] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:49.824362 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:49.825842 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:49.841273 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e0949-0cad-403e-8969-e1ca3fcbd85c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:49.850801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:49.851703 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:49.851984 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:49.852265 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] PATH_INFO: `/v3/projects/314b6396998a4ae68c6d01a80bb61df5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:49.855049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=314b6396998a4ae68c6d01a80bb61df5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:49.856860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:49.980504 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:49.981654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:49.981654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:49.999949 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] MFA Rules not processed for user `5d57c26ab8cb4b81b0271887de8de62f`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:57:50.001208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:50.010167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314b6396998a4ae68c6d01a80bb61df5', 'request_id': 'req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:50.020945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:50.072644 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1382/2772] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:57:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 08:57:50.105912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314b6396998a4ae68c6d01a80bb61df5', 'request_id': 'req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:50.112791 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314b6396998a4ae68c6d01a80bb61df5', 'request_id': 'req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:50.126061 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] The token cache is being invalidate because project 314b6396998a4ae68c6d01a80bb61df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:57:50.126452 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:50.127206 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:57:50.128937 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1391/2773] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:57:49 2022] DELETE /identity/v3/projects/314b6396998a4ae68c6d01a80bb61df5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:57:50.428617 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:50.430361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:50.491800 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c34b-eb46-4682-b446-ce2f403bd700 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:50.495847 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:50.496513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:50.496513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:50.496513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:50.498923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:50.510797 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:50.511978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:50.520845 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1383/2774] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:51.954076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:51.955542 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:52.081716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f22dfd-8c8a-454a-a5c2-e19fcb03aaee admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:52.088468 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:52.089599 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:52.090152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:52.090649 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:52.093956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:52.110457 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:52.112274 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:52.125328 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1392/2775] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:57.658880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:57.660870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:57.811967 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010437c8-77ad-4db2-9b7f-3fe34840a817 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:57.819601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fd190-6085-482e-b4e1-117b25c1e212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:57.820530 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd190-6085-482e-b4e1-117b25c1e212 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:57.820941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd190-6085-482e-b4e1-117b25c1e212 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:57.821293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd190-6085-482e-b4e1-117b25c1e212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:57.823680 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-eb0fd190-6085-482e-b4e1-117b25c1e212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:57.849528 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fd190-6085-482e-b4e1-117b25c1e212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:57.853374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fd190-6085-482e-b4e1-117b25c1e212 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:57.868133 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1384/2776] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:57:59.632700 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:57:59.634377 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:59.650572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66709fc-e7ec-4231-91d7-5ada26f7bd16 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:57:59.658946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:57:59.659875 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:57:59.660335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:57:59.660787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:57:59.663678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:57:59.687010 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:57:59.693373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:57:59.702509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:59.710985 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1393/2777] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:57:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:58:07.778874 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b43f7-bd2c-4d4b-9344-e0a0cc4c60bb None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:07.779362 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b43f7-bd2c-4d4b-9344-e0a0cc4c60bb None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:07.779469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b43f7-bd2c-4d4b-9344-e0a0cc4c60bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:07.830477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-de5b43f7-bd2c-4d4b-9344-e0a0cc4c60bb None None] MFA Rules not processed for user `5eb2a0bf9048456db54210694918b016`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:58:07.833278 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-de5b43f7-bd2c-4d4b-9344-e0a0cc4c60bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:07.860566 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=100 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:07.901690 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1385/2778] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 08:58:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:58:08.087450 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:58:08.088948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:08.118509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b43f7-bd2c-4d4b-9344-e0a0cc4c60bb None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:58:08.134411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b43f7-bd2c-4d4b-9344-e0a0cc4c60bb None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:58:08.140218 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:58:08.143336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:08.143336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:08.143336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:08.143629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:08.157214 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:58:08.158869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:58:08.170451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1386/2779] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:58:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:58:08.200759 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6603659-196b-40d2-bfe2-255f8b8a81d5 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:58:08.204612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083f9aa9e5d84adbb8a82f1b0addd788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:58:08.205276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:08.205613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:08.205990 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:08.216277 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:58:08.217913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:58:08.227574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1394/2780] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 08:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 08:58:13.027327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:58:13.029467 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:13.057108 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870757b-ab99-4e36-a12c-f87f71d8b268 service nova] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:58:13.066810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:58:13.068178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:13.068758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:13.069427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:13.073028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:13.092959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:58:13.095811 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:58:13.116056 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1387/2781] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:58:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:58:16.833018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:58:16.834819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:16.901539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd0c0-71f0-4e26-936d-6952cf699af5 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:58:16.906165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:58:16.907029 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:16.907312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:16.907587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] PATH_INFO: `/v3/users/5fc92ccbc3b54cd286430ae18312d6fb` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:16.908768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc92ccbc3b54cd286430ae18312d6fb)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:58:16.910724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:58:17.131037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc92ccbc3b54cd286430ae18312d6fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.131741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc92ccbc3b54cd286430ae18312d6fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.144433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc92ccbc3b54cd286430ae18312d6fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.150456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:17.156829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc92ccbc3b54cd286430ae18312d6fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.156829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc92ccbc3b54cd286430ae18312d6fb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.278480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1395/2782] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:58:16 2022] DELETE /identity/v3/users/5fc92ccbc3b54cd286430ae18312d6fb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:58:17.530885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:58:17.547159 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c45c-c91b-45bf-8f24-5d885b242d3d service placement] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:58:17.605279 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:58:17.606186 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:17.606478 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:17.606785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] PATH_INFO: `/v3/projects/6d5c6b91cdb34d4583f177e691c25c2f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:17.607978 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5c6b91cdb34d4583f177e691c25c2f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:58:17.609938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:58:17.713256 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5c6b91cdb34d4583f177e691c25c2f', 'request_id': 'req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.718892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5c6b91cdb34d4583f177e691c25c2f', 'request_id': 'req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.725422 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5c6b91cdb34d4583f177e691c25c2f', 'request_id': 'req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.853113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] The token cache is being invalidate because project 6d5c6b91cdb34d4583f177e691c25c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:58:17.853409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.854137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:17.855841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1388/2783] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:58:17 2022] DELETE /identity/v3/projects/6d5c6b91cdb34d4583f177e691c25c2f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:58:17.859903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:58:17.861356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:17.874869 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b690bf-200b-41b9-83c3-a28a6ff3e87a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:58:17.932287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:58:17.933219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:17.933530 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:17.933846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] PATH_INFO: `/v3/users/cf2c7132204a43b1b4cf357e35039500` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:17.935067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2c7132204a43b1b4cf357e35039500)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:58:17.937003 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:58:18.103495 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2c7132204a43b1b4cf357e35039500'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.104480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2c7132204a43b1b4cf357e35039500'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.116433 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2c7132204a43b1b4cf357e35039500'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.124279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2c7132204a43b1b4cf357e35039500'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.125045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2c7132204a43b1b4cf357e35039500'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.186932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1396/2784] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 08:58:17 2022] DELETE /identity/v3/users/cf2c7132204a43b1b4cf357e35039500 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:58:18.451719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:58:18.453280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:58:18.473582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca613-6289-40a4-bd0e-fb27f0b7b79e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:58:18.505935 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:18.535058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:58:18.535852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:58:18.536137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:58:18.536415 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] PATH_INFO: `/v3/projects/7f090db227874a9baabb6dba364be9e6` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:58:18.537717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f090db227874a9baabb6dba364be9e6)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:58:18.539792 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:58:18.655881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f090db227874a9baabb6dba364be9e6', 'request_id': 'req-a2410d1f-2d21-4833-9faa-93dad02113de'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.661651 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f090db227874a9baabb6dba364be9e6', 'request_id': 'req-a2410d1f-2d21-4833-9faa-93dad02113de'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.668784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f090db227874a9baabb6dba364be9e6', 'request_id': 'req-a2410d1f-2d21-4833-9faa-93dad02113de'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.774305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] The token cache is being invalidate because project 7f090db227874a9baabb6dba364be9e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 08:58:18.774599 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.775226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a2410d1f-2d21-4833-9faa-93dad02113de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 08:58:18.776780 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1389/2785] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 08:58:18 2022] DELETE /identity/v3/projects/7f090db227874a9baabb6dba364be9e6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 08:58:28.182886 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:28.771043 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:59:19.028693 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:59:19.030247 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:59:19.098753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10971-b7fe-4e82-9d5a-a070de937b0d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:59:19.158501 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:59:19.159159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:59:19.159443 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:59:19.159722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:59:19.162442 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:59:19.174148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:59:19.175739 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:59:19.186373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1397/2786] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:59:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:59:29.181817 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=58 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:59:44.574787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:59:44.575374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:59:44.575374 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:59:44.593392 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] MFA Rules not processed for user `5d57c26ab8cb4b81b0271887de8de62f`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 08:59:44.594757 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:59:44.651593 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1390/2787] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 08:59:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 08:59:44.955211 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 08:59:44.956616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:59:45.012415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1ee03-70c9-467e-aa28-b5c0d1cb9309 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 08:59:45.015972 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 08:59:45.016638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 08:59:45.016921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 08:59:45.017193 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 08:59:45.019013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 08:59:45.029650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 08:59:45.031207 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 08:59:45.040058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1398/2788] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 08:59:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 08:59:54.643869 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=25 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:59:55.035716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=26 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:01:15.785914 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:01:15.788988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:01:15.867787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f004e6e-1a8d-482e-9c04-e00e5b621f65 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:01:15.874226 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a56e-d027-4c12-a9b8-691c93958ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:01:15.874889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a56e-d027-4c12-a9b8-691c93958ae7 service nova] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:01:15.875174 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a56e-d027-4c12-a9b8-691c93958ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:01:15.875449 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a56e-d027-4c12-a9b8-691c93958ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:01:15.877262 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7f76a56e-d027-4c12-a9b8-691c93958ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:01:15.888281 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a56e-d027-4c12-a9b8-691c93958ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:01:15.889898 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a56e-d027-4c12-a9b8-691c93958ae7 service nova] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:01:15.899333 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1391/2789] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:01:17.599771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:01:17.606410 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:01:17.659163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b126e-520b-445b-bff3-11e6bcd5c8ff service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:01:17.662815 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:01:17.663463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:01:17.663753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:01:17.664036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:01:17.665973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:01:17.679688 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:01:17.681133 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:01:17.693492 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1399/2790] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:01:25.895058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=34 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:01:27.688692 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=26 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:01:30.210942 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a805de-fb1f-45c0-9b48-aa298d32b86b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:01:30.211474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a805de-fb1f-45c0-9b48-aa298d32b86b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:01:30.211578 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a805de-fb1f-45c0-9b48-aa298d32b86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:01:30.229187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-d3a805de-fb1f-45c0-9b48-aa298d32b86b None None] MFA Rules not processed for user `5d57c26ab8cb4b81b0271887de8de62f`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:01:30.230491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-d3a805de-fb1f-45c0-9b48-aa298d32b86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:01:30.238358 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1392/2791] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:01:36.648763 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:01:36.658756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139d4d3-7e67-4e09-8ce6-cac23e9b3335 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:01:36.662263 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:01:36.662894 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:01:36.663173 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:01:36.663447 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:01:36.665356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:01:36.681202 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:01:36.682710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:01:36.695016 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1400/2792] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:01:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:01:40.223904 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:01:46.689928 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:02:17.777068 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a805de-fb1f-45c0-9b48-aa298d32b86b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:02:17.787178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a805de-fb1f-45c0-9b48-aa298d32b86b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:02:17.790909 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:02:17.791555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:02:17.791844 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:02:17.792585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:02:17.794059 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:02:17.804893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:02:17.806446 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:02:17.815884 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1393/2793] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:02:27.811897 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=6 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:09.711143 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:09.715871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:09.792518 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98be7-6fa5-4521-a93c-fcc0c9f8ec13 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:09.799190 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df173c85777f45dd8ed9fb11bad366b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:09.799865 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:09.800282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:09.800572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:09.805537 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:09.820783 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:09.822620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:09.836881 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1401/2794] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:16.515551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:16.553157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd5dd-f78f-4c50-b158-594e27556a28 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:16.556901 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:16.557554 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:16.557880 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:16.558166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:16.560229 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:16.646955 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:16.648427 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:16.667480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1394/2795] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:19.835622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=28 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:20.107912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:20.109361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:20.124319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914eb5d-b422-47b5-92df-a347fbcb3e3d service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:20.130615 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:20.131354 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:20.131694 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:20.132151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:20.134053 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:20.147054 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:20.148656 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:20.158989 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1402/2796] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:20.230426 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:20.231893 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:20.246344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c19a-0a14-4f75-8f97-03040143e640 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:20.251135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:20.251997 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:20.252276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:20.252577 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] PATH_INFO: `/v3/users/5d57c26ab8cb4b81b0271887de8de62f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:20.254403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d57c26ab8cb4b81b0271887de8de62f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:20.256501 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:20.471991 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d57c26ab8cb4b81b0271887de8de62f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:20.473077 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d57c26ab8cb4b81b0271887de8de62f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:20.485349 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d57c26ab8cb4b81b0271887de8de62f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:20.493348 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d57c26ab8cb4b81b0271887de8de62f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:20.494140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-fcadf2bf-789f-426b-a99b-680c416eebf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d57c26ab8cb4b81b0271887de8de62f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:20.584267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1395/2797] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:20 2022] DELETE /identity/v3/users/5d57c26ab8cb4b81b0271887de8de62f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:20.866493 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:20.882405 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c3848-aeb8-441d-8ff4-a76939af42e3 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:20.942836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:20.943705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:20.944018 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:20.944294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] PATH_INFO: `/v3/projects/5cdb5bc15c11483aace0d9066a9e7707` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:20.945480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdb5bc15c11483aace0d9066a9e7707)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:20.947506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:21.032414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdb5bc15c11483aace0d9066a9e7707', 'request_id': 'req-b33bc1c6-918d-4c7b-b24a-faeb4854175d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:21.086921 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdb5bc15c11483aace0d9066a9e7707', 'request_id': 'req-b33bc1c6-918d-4c7b-b24a-faeb4854175d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:21.092798 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdb5bc15c11483aace0d9066a9e7707', 'request_id': 'req-b33bc1c6-918d-4c7b-b24a-faeb4854175d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:21.107156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] The token cache is being invalidate because project 5cdb5bc15c11483aace0d9066a9e7707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:21.107448 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:21.108284 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b33bc1c6-918d-4c7b-b24a-faeb4854175d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:21.110420 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1403/2798] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:20 2022] DELETE /identity/v3/projects/5cdb5bc15c11483aace0d9066a9e7707 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:21.117384 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1582-abfd-4615-a85e-dff36119491b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.118045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1582-abfd-4615-a85e-dff36119491b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.118425 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1582-abfd-4615-a85e-dff36119491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.135824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:21.178881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-ed6e1582-abfd-4615-a85e-dff36119491b None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:21.180106 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ed6e1582-abfd-4615-a85e-dff36119491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:21.239646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1396/2799] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:21.248741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37934fd-4f3c-434b-9b63-99f3b412b786 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.248741 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37934fd-4f3c-434b-9b63-99f3b412b786 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.249021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37934fd-4f3c-434b-9b63-99f3b412b786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.266800 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b37934fd-4f3c-434b-9b63-99f3b412b786 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:21.268030 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b37934fd-4f3c-434b-9b63-99f3b412b786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:21.276801 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1404/2800] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:21.281556 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e1582-abfd-4615-a85e-dff36119491b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:21.291245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e1582-abfd-4615-a85e-dff36119491b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:21.295973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:21.296654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.296938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.297210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.297964 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 09:03:21.298268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:21.299856 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:21.312249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1397/2801] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 09:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 09:03:21.317631 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37934fd-4f3c-434b-9b63-99f3b412b786 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:21.327140 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37934fd-4f3c-434b-9b63-99f3b412b786 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:21.332677 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:21.333331 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.333619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.333930 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.334622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:21.336549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:21.414319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1405/2802] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:21 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:21.418251 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:21.428782 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac47c7-d1b5-48e4-aaef-a2af1d8f887c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:21.486716 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:21.487383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.488162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.488443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.489294 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:21.491309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:21.596163 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1398/2803] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:21 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:21.600639 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:21.611434 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb7b80-be66-424c-8054-5debd1a4389d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:21.617051 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:21.617819 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.618107 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.618387 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.619117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:21.620716 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:21.631534 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1406/2804] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:21.635571 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:21.646010 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1c7e2-cb68-408b-9f2b-5d1f632ca3c9 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:21.651003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0fa96-7cf4-4131-87d2-dcb7d1cfe22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:21.651660 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fa96-7cf4-4131-87d2-dcb7d1cfe22f admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.651952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fa96-7cf4-4131-87d2-dcb7d1cfe22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.652234 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fa96-7cf4-4131-87d2-dcb7d1cfe22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.653102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0fa96-7cf4-4131-87d2-dcb7d1cfe22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:21.654734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0fa96-7cf4-4131-87d2-dcb7d1cfe22f admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:21.664691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1399/2805] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:21.668704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:21.679333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48370f3f-3478-495e-89ac-24be016a60c9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:21.683952 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:21.685082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.685368 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.685645 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] PATH_INFO: `/v3/projects/a00de20f0d8944a8bd894bc3c149e5e0/users/8a0de48683e14837ae8d9ea3947cbd9f/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.701048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00de20f0d8944a8bd894bc3c149e5e0, user_id=8a0de48683e14837ae8d9ea3947cbd9f, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:21.703735 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:21.778135 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1407/2806] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:21 2022] PUT /identity/v3/projects/a00de20f0d8944a8bd894bc3c149e5e0/users/8a0de48683e14837ae8d9ea3947cbd9f/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:21.788629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306f9c-1a52-43da-8d14-44bf40e0040a None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.788924 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306f9c-1a52-43da-8d14-44bf40e0040a None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.789208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306f9c-1a52-43da-8d14-44bf40e0040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.818538 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-19306f9c-1a52-43da-8d14-44bf40e0040a None None] MFA Rules not processed for user `8a0de48683e14837ae8d9ea3947cbd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:21.819760 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-19306f9c-1a52-43da-8d14-44bf40e0040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:21.856646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:21.888050 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1400/2807] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:21.892553 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:21.898497 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:21.955401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0346e-4b49-4693-b804-07d5e423475a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:21.960473 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:21.961132 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:21.961421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:21.961718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:21.962491 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:21.964389 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.054725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1408/2808] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:21 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 09:03:22.058864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19306f9c-1a52-43da-8d14-44bf40e0040a None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:22.070336 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19306f9c-1a52-43da-8d14-44bf40e0040a None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:22.127865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:22.128632 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.128916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.129194 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.129937 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:22.131881 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.184048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1401/2809] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:22 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:22.188174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:22.198859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0217fd-cf59-4fbf-b21d-41f1afbf1c08 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:22.203665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:22.204333 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.204673 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.204903 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.205742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:22.208088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.218978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1409/2810] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:22.223899 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:22.234181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dedeb9-17e2-4779-bd72-7163a9b588de admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:22.238872 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:22.239744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.240307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.240307 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] PATH_INFO: `/v3/projects/e862d68bd26d4257b1deea84ba72b8dc/users/90c9c972e1fb49088f333ad450115439/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.255015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e862d68bd26d4257b1deea84ba72b8dc, user_id=90c9c972e1fb49088f333ad450115439, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:22.257755 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.356011 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1402/2811] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:22 2022] PUT /identity/v3/projects/e862d68bd26d4257b1deea84ba72b8dc/users/90c9c972e1fb49088f333ad450115439/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:22.360037 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:22.370311 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c50b-6ef9-4dd8-ab3b-6b3aaef18bf1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:22.426572 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566a825-1aec-458f-a63f-131249f95ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:22.427241 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a825-1aec-458f-a63f-131249f95ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.427523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a825-1aec-458f-a63f-131249f95ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.427802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a825-1aec-458f-a63f-131249f95ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.428523 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566a825-1aec-458f-a63f-131249f95ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:22.430137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566a825-1aec-458f-a63f-131249f95ab6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.440246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1410/2812] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:22.444816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:22.455754 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc884-87df-43d2-bb34-43078bc9d3f7 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:22.461351 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:22.462276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.462562 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.462837 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] PATH_INFO: `/v3/projects/e862d68bd26d4257b1deea84ba72b8dc/users/90c9c972e1fb49088f333ad450115439/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.464840 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e862d68bd26d4257b1deea84ba72b8dc, user_id=90c9c972e1fb49088f333ad450115439, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:22.467555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.478573 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1403/2813] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:22 2022] PUT /identity/v3/projects/e862d68bd26d4257b1deea84ba72b8dc/users/90c9c972e1fb49088f333ad450115439/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:22.489935 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb8e91-a560-442c-aff1-e97e48e17f7b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.490233 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb8e91-a560-442c-aff1-e97e48e17f7b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.490514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb8e91-a560-442c-aff1-e97e48e17f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.516579 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-15fb8e91-a560-442c-aff1-e97e48e17f7b None None] MFA Rules not processed for user `90c9c972e1fb49088f333ad450115439`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:22.517874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-15fb8e91-a560-442c-aff1-e97e48e17f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:22.583809 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:22.588992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1411/2814] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:22.601537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:22.603269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:22.682451 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448c208-424c-4408-98de-8ad72a2736f8 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:22.686652 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:22.687301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.687585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.687865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.697810 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:22.699259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.709582 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1404/2815] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:22.865363 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb8e91-a560-442c-aff1-e97e48e17f7b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:22.875444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb8e91-a560-442c-aff1-e97e48e17f7b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:22.880009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14f3b5-05cd-486e-b86f-c4cf37d8cadd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:22.880652 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f3b5-05cd-486e-b86f-c4cf37d8cadd service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:22.880940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f3b5-05cd-486e-b86f-c4cf37d8cadd service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:22.881220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f3b5-05cd-486e-b86f-c4cf37d8cadd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:22.938184 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14f3b5-05cd-486e-b86f-c4cf37d8cadd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:22.939660 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14f3b5-05cd-486e-b86f-c4cf37d8cadd service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:22.949237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1412/2816] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:31.233894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:31.247142 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:31.424982 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8efe90-5e96-40ee-8a3d-bb91225bb056 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:31.430151 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:31.431016 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:31.431303 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:31.431585 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] PATH_INFO: `/v3/users/8a0de48683e14837ae8d9ea3947cbd9f` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:31.432784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0de48683e14837ae8d9ea3947cbd9f)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:31.434998 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:31.569922 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0de48683e14837ae8d9ea3947cbd9f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:31.570586 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0de48683e14837ae8d9ea3947cbd9f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:31.583277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0de48683e14837ae8d9ea3947cbd9f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:31.591506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0de48683e14837ae8d9ea3947cbd9f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:31.592225 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0de48683e14837ae8d9ea3947cbd9f'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:31.652109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1405/2817] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:31 2022] DELETE /identity/v3/users/8a0de48683e14837ae8d9ea3947cbd9f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:31.656992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:31.657485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:31.657585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:31.675270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:31.677023 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:31.734623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1413/2818] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:31.745114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:31.746570 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:31.815269 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ddc76-b7c2-462d-ae73-c07169c4acea admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:31.819093 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:31.819741 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:31.820029 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:31.820305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:31.829713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:31.831167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:31.841469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1406/2819] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:32.219761 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:32.221174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:32.237654 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57873d-376c-43c1-8ac1-d50160510c41 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:32.242846 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:32.243778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:32.243950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:32.244224 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] PATH_INFO: `/v3/projects/a00de20f0d8944a8bd894bc3c149e5e0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:32.245422 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00de20f0d8944a8bd894bc3c149e5e0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:32.250315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:32.361616 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00de20f0d8944a8bd894bc3c149e5e0', 'request_id': 'req-0cbae447-a0a9-4830-8182-cacaea92b10c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.429355 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00de20f0d8944a8bd894bc3c149e5e0', 'request_id': 'req-0cbae447-a0a9-4830-8182-cacaea92b10c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.435925 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00de20f0d8944a8bd894bc3c149e5e0', 'request_id': 'req-0cbae447-a0a9-4830-8182-cacaea92b10c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.447651 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] The token cache is being invalidate because project a00de20f0d8944a8bd894bc3c149e5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:32.447943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.448586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.450169 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1414/2820] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:32 2022] DELETE /identity/v3/projects/a00de20f0d8944a8bd894bc3c149e5e0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:32.454306 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:32.464714 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2be89e-f6f1-4501-b057-9eb1d5c5d935 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:32.482463 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:32.521934 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:32.522863 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:32.523158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:32.523433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] PATH_INFO: `/v3/users/90c9c972e1fb49088f333ad450115439` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:32.524673 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c9c972e1fb49088f333ad450115439)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:32.526813 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:32.671799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c9c972e1fb49088f333ad450115439'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.672482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c9c972e1fb49088f333ad450115439'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.685482 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c9c972e1fb49088f333ad450115439'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.693210 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c9c972e1fb49088f333ad450115439'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.693954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d90813f4-613e-4a69-9914-46520083a583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c9c972e1fb49088f333ad450115439'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:32.772330 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1407/2821] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:32 2022] DELETE /identity/v3/users/90c9c972e1fb49088f333ad450115439 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:33.162753 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:33.164229 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:33.180149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae447-a0a9-4830-8182-cacaea92b10c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:33.200072 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:33.239326 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:33.240192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.240474 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.240746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] PATH_INFO: `/v3/projects/e862d68bd26d4257b1deea84ba72b8dc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.241973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e862d68bd26d4257b1deea84ba72b8dc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:33.243897 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:33.343657 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e862d68bd26d4257b1deea84ba72b8dc', 'request_id': 'req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:33.412437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e862d68bd26d4257b1deea84ba72b8dc', 'request_id': 'req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:33.418622 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e862d68bd26d4257b1deea84ba72b8dc', 'request_id': 'req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:33.430595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] The token cache is being invalidate because project e862d68bd26d4257b1deea84ba72b8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:33.430885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:33.431528 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e35b1ea1-5fbe-40c1-bdbf-b4ba9e5613c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:33.433063 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1415/2822] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:33 2022] DELETE /identity/v3/projects/e862d68bd26d4257b1deea84ba72b8dc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:33.438423 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575270a2-d8bf-4c50-abfc-be19836a19c0 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.438709 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575270a2-d8bf-4c50-abfc-be19836a19c0 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.438989 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575270a2-d8bf-4c50-abfc-be19836a19c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.457809 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-575270a2-d8bf-4c50-abfc-be19836a19c0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:33.459064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-575270a2-d8bf-4c50-abfc-be19836a19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:33.518038 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1408/2823] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:33.526412 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1177-1a90-4437-9a2f-2fc1c76f6ff0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.526701 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1177-1a90-4437-9a2f-2fc1c76f6ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.526978 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1177-1a90-4437-9a2f-2fc1c76f6ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.546186 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b93a1177-1a90-4437-9a2f-2fc1c76f6ff0 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:33.547414 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b93a1177-1a90-4437-9a2f-2fc1c76f6ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:33.555513 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1416/2824] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:33.560021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575270a2-d8bf-4c50-abfc-be19836a19c0 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:33.570238 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575270a2-d8bf-4c50-abfc-be19836a19c0 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:33.574938 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:33.575591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.575878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.576154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.576882 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 09:03:33.577200 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:33.578829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:33.591265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1409/2825] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 09:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 09:03:33.595665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a1177-1a90-4437-9a2f-2fc1c76f6ff0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:33.606584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a1177-1a90-4437-9a2f-2fc1c76f6ff0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:33.611349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:33.612004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.612288 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.613151 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.613307 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:33.615509 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:33.682404 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1417/2826] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:33 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:33.690513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:33.700638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa71f-5fa4-4dbe-8624-75d6a01d6e6b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:33.728995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:33.760063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:33.760731 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.761014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.761290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.762015 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:33.763941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:33.904646 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1410/2827] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:33 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:33.908732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:33.919610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da02e8-08e1-4757-a558-52440dc62553 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:33.924334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:33.924992 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.925278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.925551 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.926482 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:33.928080 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:33.943852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1418/2828] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:33.946587 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:33.956970 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f85ffb-cc4f-4170-81ac-61c78edda730 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:33.962379 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe44bf-6e7b-4e46-9fb0-98aa510b5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:33.963039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe44bf-6e7b-4e46-9fb0-98aa510b5e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:33.963329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe44bf-6e7b-4e46-9fb0-98aa510b5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:33.963650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe44bf-6e7b-4e46-9fb0-98aa510b5e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:33.964383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe44bf-6e7b-4e46-9fb0-98aa510b5e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:33.966028 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe44bf-6e7b-4e46-9fb0-98aa510b5e54 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:33.976287 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1411/2829] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:33.980419 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:33.991021 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5fd9f-9095-4ab2-b504-e399807d5555 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:33.995900 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.001293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.001293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.001293 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] PATH_INFO: `/v3/projects/1ae54abea34d4fb8838b0ddc20f82930/users/4e4aa619d7e64caca197bcddac0eb86b/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.013222 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae54abea34d4fb8838b0ddc20f82930, user_id=4e4aa619d7e64caca197bcddac0eb86b, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.015942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:34.098279 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1419/2830] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:33 2022] PUT /identity/v3/projects/1ae54abea34d4fb8838b0ddc20f82930/users/4e4aa619d7e64caca197bcddac0eb86b/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:34.108543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722e15-a74c-4a91-9ee4-8aa0b950344b None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.108833 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722e15-a74c-4a91-9ee4-8aa0b950344b None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.109109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722e15-a74c-4a91-9ee4-8aa0b950344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.135742 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-aa722e15-a74c-4a91-9ee4-8aa0b950344b None None] MFA Rules not processed for user `4e4aa619d7e64caca197bcddac0eb86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:34.136954 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-aa722e15-a74c-4a91-9ee4-8aa0b950344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:34.201456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1412/2831] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:34.205938 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:34.256275 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:34.269811 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1dfd8-11c3-4081-a427-958a4ca4aa11 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:34.274848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.275514 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.275802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.276082 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.276786 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.278746 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:34.385873 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1420/2832] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:34 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:34.389979 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa722e15-a74c-4a91-9ee4-8aa0b950344b None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:34.400875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa722e15-a74c-4a91-9ee4-8aa0b950344b None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:34.458681 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.459345 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.459575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.459854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.460785 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.462865 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:34.538445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1413/2833] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:34 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:34.542618 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:34.554409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33eb0c-6b71-4fbd-88d4-6fbe27d30d4d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:34.559170 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.560167 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.560409 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.560684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.561415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.563045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:34.575756 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1421/2834] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:34.578576 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:34.588614 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100aced-6fbe-44eb-a0d5-b6a75491f935 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:34.593167 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.594111 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.594395 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.594671 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] PATH_INFO: `/v3/projects/ab8153d07f8346a8a4487cc2b1feb574/users/3f247ffc29dc4820ad2b1bc070d4cb23/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.610401 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8153d07f8346a8a4487cc2b1feb574, user_id=3f247ffc29dc4820ad2b1bc070d4cb23, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.613189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:34.669428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1414/2835] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:34 2022] PUT /identity/v3/projects/ab8153d07f8346a8a4487cc2b1feb574/users/3f247ffc29dc4820ad2b1bc070d4cb23/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:34.673460 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:34.684956 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83924e1d-c9be-48db-b5ab-4a708c536e10 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:34.741444 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281aa58-8ac9-4988-8fc3-e2b8c9145ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.742058 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281aa58-8ac9-4988-8fc3-e2b8c9145ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.742346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281aa58-8ac9-4988-8fc3-e2b8c9145ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.742623 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281aa58-8ac9-4988-8fc3-e2b8c9145ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.743379 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281aa58-8ac9-4988-8fc3-e2b8c9145ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.744971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281aa58-8ac9-4988-8fc3-e2b8c9145ac3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:34.754674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1422/2836] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:34.758870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:34.764389 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:34.769650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a7c0-ab29-4a22-bf52-abdfb0a7bb2b admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:34.774480 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.778344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.778344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.778344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] PATH_INFO: `/v3/projects/ab8153d07f8346a8a4487cc2b1feb574/users/3f247ffc29dc4820ad2b1bc070d4cb23/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.778344 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8153d07f8346a8a4487cc2b1feb574, user_id=3f247ffc29dc4820ad2b1bc070d4cb23, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.780864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:34.793078 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1415/2837] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:34 2022] PUT /identity/v3/projects/ab8153d07f8346a8a4487cc2b1feb574/users/3f247ffc29dc4820ad2b1bc070d4cb23/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:34.805461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8ab7f-77ea-4de8-a61a-c41c27e67817 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.805787 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8ab7f-77ea-4de8-a61a-c41c27e67817 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.806069 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8ab7f-77ea-4de8-a61a-c41c27e67817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.833392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6ab8ab7f-77ea-4de8-a61a-c41c27e67817 None None] MFA Rules not processed for user `3f247ffc29dc4820ad2b1bc070d4cb23`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:34.834722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6ab8ab7f-77ea-4de8-a61a-c41c27e67817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:34.903552 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1423/2838] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:34.917065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:34.918843 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:34.977639 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5019-f50f-4c93-8769-5dbb54f99add admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:34.981409 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d80f0-4c85-4908-bc8e-f55a80a7efda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:34.982101 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d80f0-4c85-4908-bc8e-f55a80a7efda service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:34.982386 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d80f0-4c85-4908-bc8e-f55a80a7efda service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:34.982666 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d80f0-4c85-4908-bc8e-f55a80a7efda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:34.991889 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d80f0-4c85-4908-bc8e-f55a80a7efda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:34.993266 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d80f0-4c85-4908-bc8e-f55a80a7efda service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:35.002747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1416/2839] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:35.846585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8ab7f-77ea-4de8-a61a-c41c27e67817 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:35.891860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:35.908678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8ab7f-77ea-4de8-a61a-c41c27e67817 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:35.913973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:35.914847 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:35.915127 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:35.915415 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] PATH_INFO: `/v3/users/4e4aa619d7e64caca197bcddac0eb86b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:35.916619 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4aa619d7e64caca197bcddac0eb86b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:35.918597 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:36.065237 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4aa619d7e64caca197bcddac0eb86b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.065927 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4aa619d7e64caca197bcddac0eb86b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.079100 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4aa619d7e64caca197bcddac0eb86b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.086595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4aa619d7e64caca197bcddac0eb86b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.087294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4aa619d7e64caca197bcddac0eb86b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.269973 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1424/2840] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:35 2022] DELETE /identity/v3/users/4e4aa619d7e64caca197bcddac0eb86b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:36.275228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:36.275744 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:36.275862 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:36.294061 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:36.295399 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:36.361710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1417/2841] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:36.371578 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:36.373123 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:36.432964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964adb-74a6-492a-96fa-054f0a8c3e4d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:36.436860 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:36.437506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:36.437829 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:36.438105 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:36.448360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:36.452361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:36.459557 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1425/2842] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:36.830923 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:36.832525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:36.849885 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74569ec2-822d-4652-9765-9e99e9571ff5 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:36.856076 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:36.857299 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:36.857663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:36.858089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] PATH_INFO: `/v3/projects/1ae54abea34d4fb8838b0ddc20f82930` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:36.859532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae54abea34d4fb8838b0ddc20f82930)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:36.863284 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:36.944483 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae54abea34d4fb8838b0ddc20f82930', 'request_id': 'req-7bf8585c-4276-4c91-8a06-5927e8700f8c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.950205 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae54abea34d4fb8838b0ddc20f82930', 'request_id': 'req-7bf8585c-4276-4c91-8a06-5927e8700f8c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.956371 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae54abea34d4fb8838b0ddc20f82930', 'request_id': 'req-7bf8585c-4276-4c91-8a06-5927e8700f8c'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:36.999854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] The token cache is being invalidate because project 1ae54abea34d4fb8838b0ddc20f82930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:37.000140 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.000853 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.002567 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1418/2843] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:36 2022] DELETE /identity/v3/projects/1ae54abea34d4fb8838b0ddc20f82930 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:37.006384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:37.016164 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d2d3c-0d50-4819-b204-66e2010885b9 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:37.071789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:37.072648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:37.072932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:37.073205 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] PATH_INFO: `/v3/users/3f247ffc29dc4820ad2b1bc070d4cb23` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:37.074465 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f247ffc29dc4820ad2b1bc070d4cb23)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:37.076403 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:37.081686 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:37.227071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f247ffc29dc4820ad2b1bc070d4cb23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.227757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f247ffc29dc4820ad2b1bc070d4cb23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.240182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f247ffc29dc4820ad2b1bc070d4cb23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.246959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f247ffc29dc4820ad2b1bc070d4cb23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.248857 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c453b4d8-cba0-498c-8586-c540f735fb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f247ffc29dc4820ad2b1bc070d4cb23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.343485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1426/2844] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:37 2022] DELETE /identity/v3/users/3f247ffc29dc4820ad2b1bc070d4cb23 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:37.745055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:37.746609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:37.760547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8585c-4276-4c91-8a06-5927e8700f8c admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:37.775383 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:37.820549 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:37.821419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:37.821720 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:37.822003 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] PATH_INFO: `/v3/projects/ab8153d07f8346a8a4487cc2b1feb574` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:37.823378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8153d07f8346a8a4487cc2b1feb574)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:37.825295 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:37.928212 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8153d07f8346a8a4487cc2b1feb574', 'request_id': 'req-31c5745f-5899-44c7-9edc-0870892e5acb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.933692 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8153d07f8346a8a4487cc2b1feb574', 'request_id': 'req-31c5745f-5899-44c7-9edc-0870892e5acb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:37.940042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8153d07f8346a8a4487cc2b1feb574', 'request_id': 'req-31c5745f-5899-44c7-9edc-0870892e5acb'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:38.034364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] The token cache is being invalidate because project ab8153d07f8346a8a4487cc2b1feb574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:38.034657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:38.035285 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-31c5745f-5899-44c7-9edc-0870892e5acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:38.037485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1419/2845] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:37 2022] DELETE /identity/v3/projects/ab8153d07f8346a8a4487cc2b1feb574 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:38.042535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc27089-56dd-4c4f-94de-6e5203f60d15 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.043027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc27089-56dd-4c4f-94de-6e5203f60d15 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.043155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc27089-56dd-4c4f-94de-6e5203f60d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.060923 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2dc27089-56dd-4c4f-94de-6e5203f60d15 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:38.062176 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2dc27089-56dd-4c4f-94de-6e5203f60d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:38.120793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1427/2846] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 09:03:38.128820 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a58a2-9ff6-467f-8b4d-6207bc904e7f None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.129114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a58a2-9ff6-467f-8b4d-6207bc904e7f None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.129387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a58a2-9ff6-467f-8b4d-6207bc904e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.148945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-262a58a2-9ff6-467f-8b4d-6207bc904e7f None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:38.151052 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-262a58a2-9ff6-467f-8b4d-6207bc904e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:38.159258 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1420/2847] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:38.164117 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc27089-56dd-4c4f-94de-6e5203f60d15 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:38.173962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc27089-56dd-4c4f-94de-6e5203f60d15 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:38.179163 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:38.179757 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.180050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.180320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.181052 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 09:03:38.181361 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:38.182997 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:38.194905 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1428/2848] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 09:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 09:03:38.199065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a58a2-9ff6-467f-8b4d-6207bc904e7f None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:38.209380 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a58a2-9ff6-467f-8b4d-6207bc904e7f None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:38.214173 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:38.214828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.215114 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.215391 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.216088 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:38.218045 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:38.311498 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1421/2849] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:38 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:38.315845 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:38.327775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af666-2739-43ce-8c84-701b409935d9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:38.385647 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:38.386351 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.386638 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.386913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.387613 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:38.389540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:38.486762 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1429/2850] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:38 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:38.491002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:38.501222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db483-b817-4c65-a14a-98d70bafcf80 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:38.506452 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:38.507109 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.507539 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.507710 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.508403 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:38.510026 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:38.521962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1422/2851] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:38.526771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:38.531742 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:38.537577 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34906-087f-406f-a070-4134a6ea018f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:38.545343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20320b62-4166-443d-8b81-739db959c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:38.545343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320b62-4166-443d-8b81-739db959c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.545343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320b62-4166-443d-8b81-739db959c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.545343 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320b62-4166-443d-8b81-739db959c5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.545797 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20320b62-4166-443d-8b81-739db959c5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:38.546214 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20320b62-4166-443d-8b81-739db959c5ce admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:38.557718 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1430/2852] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:38.562359 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:38.576042 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269424-68d8-44d8-9257-d559bcdf30ef admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:38.578182 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:38.579057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.579338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.579610 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] PATH_INFO: `/v3/projects/d056647db61f48a59b8d61b6a8c2f1b8/users/3a6b6a9787e94a34939113cced425e56/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.595267 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d056647db61f48a59b8d61b6a8c2f1b8, user_id=3a6b6a9787e94a34939113cced425e56, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:38.597992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:38.698621 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1423/2853] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:38 2022] PUT /identity/v3/projects/d056647db61f48a59b8d61b6a8c2f1b8/users/3a6b6a9787e94a34939113cced425e56/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:38.717093 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be753b8-6e11-4987-8d79-80a890e59f83 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.717390 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be753b8-6e11-4987-8d79-80a890e59f83 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.717724 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be753b8-6e11-4987-8d79-80a890e59f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.745073 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8be753b8-6e11-4987-8d79-80a890e59f83 None None] MFA Rules not processed for user `3a6b6a9787e94a34939113cced425e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:38.746244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8be753b8-6e11-4987-8d79-80a890e59f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:38.810481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1431/2854] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:38.814946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:38.862915 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:38.881156 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10a705-4502-4e16-bd2d-97bb31d475ea admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:38.886048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:38.886708 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:38.886995 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:38.887276 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:38.887975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:38.889912 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.031443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1424/2855] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:38 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:39.035658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be753b8-6e11-4987-8d79-80a890e59f83 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.048382 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be753b8-6e11-4987-8d79-80a890e59f83 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.109698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.110399 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.110685 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.110964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.111665 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.113648 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.179079 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1432/2856] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:39 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:39.183181 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.194444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8deb-aff7-4ed1-bdcc-06d3756e6c24 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.198980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.199706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.199988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.200259 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.200980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.202625 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.214512 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1425/2857] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:39.218602 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.228760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4e6f-0bbe-47b5-be03-874150370d43 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.233350 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c57e8-6a88-431c-b7df-a0a1eae1f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.234159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c57e8-6a88-431c-b7df-a0a1eae1f68c admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.234440 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c57e8-6a88-431c-b7df-a0a1eae1f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.234714 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c57e8-6a88-431c-b7df-a0a1eae1f68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.235439 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c57e8-6a88-431c-b7df-a0a1eae1f68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.237025 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c57e8-6a88-431c-b7df-a0a1eae1f68c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.247152 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1433/2858] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:39.251668 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.262447 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706621b-4ac5-460e-bc74-e0dca196d83e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.267118 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.268079 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.268283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.268555 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] PATH_INFO: `/v3/projects/89e11819c11846688b953a033998a9e5/users/46518c733a2c4bff941d0c305eb4689a/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.284502 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e11819c11846688b953a033998a9e5, user_id=46518c733a2c4bff941d0c305eb4689a, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.287144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.396018 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1426/2859] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:39 2022] PUT /identity/v3/projects/89e11819c11846688b953a033998a9e5/users/46518c733a2c4bff941d0c305eb4689a/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:39.462025 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4daf2f-eca9-49c8-b699-c1cec96d6d2d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.462398 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4daf2f-eca9-49c8-b699-c1cec96d6d2d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.462586 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4daf2f-eca9-49c8-b699-c1cec96d6d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.489642 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-af4daf2f-eca9-49c8-b699-c1cec96d6d2d None None] MFA Rules not processed for user `46518c733a2c4bff941d0c305eb4689a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:39.491013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-af4daf2f-eca9-49c8-b699-c1cec96d6d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:39.539585 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:39.557192 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1434/2860] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:39.561943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.624974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22d502-21d2-4416-86bc-3261a5044bab admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.629609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.630364 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.630642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.630920 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.631650 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.633550 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.733875 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1427/2861] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:39 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:39.738406 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4daf2f-eca9-49c8-b699-c1cec96d6d2d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.749962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4daf2f-eca9-49c8-b699-c1cec96d6d2d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.809531 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.810266 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.810556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.810836 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.811535 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.813485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.881981 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1435/2862] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:39 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:39.886031 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.897575 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5c3de-6227-4171-a193-25f20b5bbef3 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.902419 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.903090 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.903378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.903663 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.904397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.906058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:39.916735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1428/2863] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:39.921209 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:39.931911 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45381844-2a13-4cb2-b7ef-5f59754ef9f8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:39.937083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:39.938005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:39.938290 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:39.938567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] PATH_INFO: `/v3/projects/c5dec58976de47a8b3a0bce54cb9e23c/users/09d305915b614110aaf0104294b454aa/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:39.954242 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dec58976de47a8b3a0bce54cb9e23c, user_id=09d305915b614110aaf0104294b454aa, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:39.956915 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:40.000334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1436/2864] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:39 2022] PUT /identity/v3/projects/c5dec58976de47a8b3a0bce54cb9e23c/users/09d305915b614110aaf0104294b454aa/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:40.004252 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:40.014719 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bff0bc-9f49-4cd7-aa26-85860154aeda admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:40.069706 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42bc41-9c57-473f-95e4-28a81d231391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:40.070283 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42bc41-9c57-473f-95e4-28a81d231391 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:40.070564 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42bc41-9c57-473f-95e4-28a81d231391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:40.070836 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42bc41-9c57-473f-95e4-28a81d231391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:40.071552 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42bc41-9c57-473f-95e4-28a81d231391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:40.073137 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42bc41-9c57-473f-95e4-28a81d231391 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:40.082801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1429/2865] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:40.087536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:40.097986 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa729c3-90df-4008-8387-e37dbab92472 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:40.102704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:40.103581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:40.103870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:40.104150 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] PATH_INFO: `/v3/projects/c5dec58976de47a8b3a0bce54cb9e23c/users/09d305915b614110aaf0104294b454aa/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:40.106196 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dec58976de47a8b3a0bce54cb9e23c, user_id=09d305915b614110aaf0104294b454aa, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:40.108868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:40.119182 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1437/2866] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:40 2022] PUT /identity/v3/projects/c5dec58976de47a8b3a0bce54cb9e23c/users/09d305915b614110aaf0104294b454aa/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:40.129107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:40.129397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:40.130219 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:40.136080 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:40.156861 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] MFA Rules not processed for user `09d305915b614110aaf0104294b454aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:40.158107 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:40.228277 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1430/2867] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:40.238988 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:40.241456 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:40.301126 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf113508-528c-4d22-8e64-7c749abb1d84 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:40.305004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:40.305662 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:40.305987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:40.306270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:40.315792 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:40.317287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:40.327159 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1438/2868] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:41.370007 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:41.370488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:41.382580 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8c1c-9530-4943-bf9d-bb88ccad20ca None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:41.386179 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:41.386818 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:41.387102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:41.387377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:41.445852 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:41.447361 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:41.456678 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1431/2869] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:46.266195 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:46.275289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56401aa2-3903-482a-8f82-1294039ca3a2 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:46.279220 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461296a-5b03-4859-a2d5-ebd9e2625f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:46.279858 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461296a-5b03-4859-a2d5-ebd9e2625f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:46.280139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461296a-5b03-4859-a2d5-ebd9e2625f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:46.280413 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461296a-5b03-4859-a2d5-ebd9e2625f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:46.325612 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:46.340013 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461296a-5b03-4859-a2d5-ebd9e2625f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:46.341466 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461296a-5b03-4859-a2d5-ebd9e2625f85 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:46.351394 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1439/2870] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:50.084597 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:50.146477 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a505d7d-7ffc-456c-aac6-fc781411ab60 service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:50.151201 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:50.152066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:50.152352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:50.152631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] PATH_INFO: `/v3/users/3a6b6a9787e94a34939113cced425e56` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:50.153858 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6b6a9787e94a34939113cced425e56)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:50.155786 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:50.219734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:50.306378 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6b6a9787e94a34939113cced425e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:50.307087 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6b6a9787e94a34939113cced425e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:50.319459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6b6a9787e94a34939113cced425e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:50.327089 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6b6a9787e94a34939113cced425e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:50.327770 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6b6a9787e94a34939113cced425e56'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:50.394787 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1432/2871] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:50 2022] DELETE /identity/v3/users/3a6b6a9787e94a34939113cced425e56 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:50.399778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:50.400540 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:50.400749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:50.418695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:50.419926 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:50.480755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1440/2872] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:50.491320 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:50.492636 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:50.552945 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f218b16-9437-4a78-8e0d-0be403967439 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:50.557291 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:50.557959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:50.558268 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:50.558548 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:50.568154 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:50.569653 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:50.579848 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1433/2873] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:51.025583 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:51.027099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:51.042658 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1502234-6e66-4c56-8e11-64706ddf8603 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:51.047663 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:51.048571 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:51.048859 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:51.049139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] PATH_INFO: `/v3/projects/d056647db61f48a59b8d61b6a8c2f1b8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:51.050515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d056647db61f48a59b8d61b6a8c2f1b8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:51.052425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:51.195678 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd056647db61f48a59b8d61b6a8c2f1b8', 'request_id': 'req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.280223 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd056647db61f48a59b8d61b6a8c2f1b8', 'request_id': 'req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.286471 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd056647db61f48a59b8d61b6a8c2f1b8', 'request_id': 'req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.298944 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] The token cache is being invalidate because project d056647db61f48a59b8d61b6a8c2f1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:51.299261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.299910 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.301481 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1441/2874] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:51 2022] DELETE /identity/v3/projects/d056647db61f48a59b8d61b6a8c2f1b8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:51.305713 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:51.316421 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897b21f-e446-4b74-9561-a5ee1070a590 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:51.374994 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:51.375854 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:51.376382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:51.376662 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] PATH_INFO: `/v3/users/46518c733a2c4bff941d0c305eb4689a` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:51.377906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=46518c733a2c4bff941d0c305eb4689a)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:51.379827 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:51.586962 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46518c733a2c4bff941d0c305eb4689a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.587624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46518c733a2c4bff941d0c305eb4689a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.589609 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:51.599892 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46518c733a2c4bff941d0c305eb4689a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.607020 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46518c733a2c4bff941d0c305eb4689a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.607712 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46518c733a2c4bff941d0c305eb4689a'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:51.668959 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1434/2875] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:51 2022] DELETE /identity/v3/users/46518c733a2c4bff941d0c305eb4689a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:52.047581 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:52.053306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:52.064084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0fa28-25e1-49a4-a5a5-23a3ab1c9623 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:52.121049 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:52.121946 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:52.122235 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:52.122515 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] PATH_INFO: `/v3/projects/89e11819c11846688b953a033998a9e5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:52.123705 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e11819c11846688b953a033998a9e5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:52.125620 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:52.134312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:52.229432 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e11819c11846688b953a033998a9e5', 'request_id': 'req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.263039 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e11819c11846688b953a033998a9e5', 'request_id': 'req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.268814 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e11819c11846688b953a033998a9e5', 'request_id': 'req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.280625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] The token cache is being invalidate because project 89e11819c11846688b953a033998a9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:52.280940 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.281754 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.283335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1442/2876] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:52 2022] DELETE /identity/v3/projects/89e11819c11846688b953a033998a9e5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:52.287329 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:52.289309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:52.302126 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37ed10-b22b-4416-a6b0-db553de700fc admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:52.360308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:52.361097 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:52.361382 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:52.361657 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] PATH_INFO: `/v3/users/09d305915b614110aaf0104294b454aa` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:52.362951 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d305915b614110aaf0104294b454aa)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:52.364929 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:52.557280 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d305915b614110aaf0104294b454aa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.557969 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d305915b614110aaf0104294b454aa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.570208 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d305915b614110aaf0104294b454aa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.576931 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d305915b614110aaf0104294b454aa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.577602 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-b9bde42d-82f1-4e03-a634-a2e324a513ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d305915b614110aaf0104294b454aa'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:52.675012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1435/2877] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:03:52 2022] DELETE /identity/v3/users/09d305915b614110aaf0104294b454aa => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:53.071006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:53.072564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:53.086028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beeeea-b3e9-4642-9851-b8fbbcdb6f2a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:53.143539 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:53.144485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.144775 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.145048 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] PATH_INFO: `/v3/projects/c5dec58976de47a8b3a0bce54cb9e23c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.147650 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5dec58976de47a8b3a0bce54cb9e23c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:53.148888 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:53.258319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5dec58976de47a8b3a0bce54cb9e23c', 'request_id': 'req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:53.320932 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5dec58976de47a8b3a0bce54cb9e23c', 'request_id': 'req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:53.326889 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5dec58976de47a8b3a0bce54cb9e23c', 'request_id': 'req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:53.338312 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] The token cache is being invalidate because project c5dec58976de47a8b3a0bce54cb9e23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:03:53.338603 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:53.339240 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-b8d5651a-648b-4e94-b31b-d3cdd65b6f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:03:53.340777 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1443/2878] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:03:53 2022] DELETE /identity/v3/projects/c5dec58976de47a8b3a0bce54cb9e23c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:53.347828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d8f6e-81b4-4a7d-ab68-ed65c870f618 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.347828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d8f6e-81b4-4a7d-ab68-ed65c870f618 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.347828 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d8f6e-81b4-4a7d-ab68-ed65c870f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.366272 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-fb2d8f6e-81b4-4a7d-ab68-ed65c870f618 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:53.368260 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-fb2d8f6e-81b4-4a7d-ab68-ed65c870f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:53.410139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:53.427707 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1436/2879] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:53.438155 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccb3ef-504a-4fec-bf74-d771816bd5d2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.438451 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccb3ef-504a-4fec-bf74-d771816bd5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.438734 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccb3ef-504a-4fec-bf74-d771816bd5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.458341 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-93ccb3ef-504a-4fec-bf74-d771816bd5d2 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:53.459574 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-93ccb3ef-504a-4fec-bf74-d771816bd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:53.468201 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1444/2880] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:53.472543 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d8f6e-81b4-4a7d-ab68-ed65c870f618 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:53.482542 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d8f6e-81b4-4a7d-ab68-ed65c870f618 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:53.487424 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:53.488075 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.488357 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.488629 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.489352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 09:03:53.489654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:53.492102 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:53.504545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1437/2881] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 09:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 09:03:53.509793 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccb3ef-504a-4fec-bf74-d771816bd5d2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:53.519244 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccb3ef-504a-4fec-bf74-d771816bd5d2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:53.524384 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:53.525050 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.525342 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.525625 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.526370 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:53.528289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:53.612267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:53.620521 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1445/2882] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:53 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 09:03:53.624791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:53.636290 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043e72e-de3d-499a-9cfd-78c75a258b92 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:53.694121 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:53.694866 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.695157 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.695434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.696139 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:53.698112 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:53.760377 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1438/2883] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:53 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:53.765959 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:53.776664 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cc5e8-5d70-4a3e-b9ff-4c79d5ed53d6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:53.781601 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:53.782294 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.782584 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.782868 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.783595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:53.785226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:53.797408 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1446/2884] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:53.801338 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:53.812509 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e3000-d293-49ac-b9d4-4a6a968103d0 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:53.817209 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863aee9-eb2f-41e5-af04-7f65f24f8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:53.817906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863aee9-eb2f-41e5-af04-7f65f24f8a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.818187 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863aee9-eb2f-41e5-af04-7f65f24f8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.818459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863aee9-eb2f-41e5-af04-7f65f24f8a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.819178 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863aee9-eb2f-41e5-af04-7f65f24f8a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:53.820816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863aee9-eb2f-41e5-af04-7f65f24f8a97 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:53.830601 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1439/2885] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:53.834991 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:53.845278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a86db2-10ef-4c64-9c4d-f0b04f87c8bb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:53.850084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:53.851485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.851768 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.852045 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] PATH_INFO: `/v3/projects/0a38acc32e3041b4a1b8df2855249167/users/9c80cb1e22cb4a5da0bc7e5a192b3539/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:53.867295 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a38acc32e3041b4a1b8df2855249167, user_id=9c80cb1e22cb4a5da0bc7e5a192b3539, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:53.870000 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:53.966227 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1447/2886] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:53 2022] PUT /identity/v3/projects/0a38acc32e3041b4a1b8df2855249167/users/9c80cb1e22cb4a5da0bc7e5a192b3539/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 09:03:53.978413 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594bed-cc89-4718-91df-8ecb1c1d1abd None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:53.978734 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594bed-cc89-4718-91df-8ecb1c1d1abd None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:53.979014 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594bed-cc89-4718-91df-8ecb1c1d1abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.006735 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-57594bed-cc89-4718-91df-8ecb1c1d1abd None None] MFA Rules not processed for user `9c80cb1e22cb4a5da0bc7e5a192b3539`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:54.008537 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-57594bed-cc89-4718-91df-8ecb1c1d1abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:54.072099 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1440/2887] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:54.076740 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:54.138270 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23e7b5-3c1e-4ded-8b25-79dea5047915 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:54.143236 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:54.143902 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.144191 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.144470 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.145174 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:54.147139 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:54.230215 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1448/2888] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:03:54 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:54.234051 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594bed-cc89-4718-91df-8ecb1c1d1abd None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:54.245596 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594bed-cc89-4718-91df-8ecb1c1d1abd None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:54.286988 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:54.303520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:54.304686 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.304960 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.305231 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.305956 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:54.308022 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:54.406798 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1441/2889] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:03:54 2022] POST /identity/v3/users => generated 307 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:03:54.411319 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:54.422506 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695179b-dcc8-4d58-9ca5-2159a16d22f6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:54.427245 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:54.427908 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.428208 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.428587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.429802 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:54.431543 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:54.442561 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1449/2890] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:54.447036 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:54.457135 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f55fe-1153-4d15-a135-3da48285c300 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:54.462039 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:54.462911 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.463249 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.463525 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] PATH_INFO: `/v3/projects/bb95e8ac15bf4c0197e88235acdd08a4/users/cefe233f7c894374af6e8f4e57f12061/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.478972 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb95e8ac15bf4c0197e88235acdd08a4, user_id=cefe233f7c894374af6e8f4e57f12061, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:54.481758 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:54.538696 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1442/2891] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:54 2022] PUT /identity/v3/projects/bb95e8ac15bf4c0197e88235acdd08a4/users/cefe233f7c894374af6e8f4e57f12061/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:54.543055 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:54.553249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b74a4b-fbe6-4ad6-a753-bc1ae00efbc6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:54.612046 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace84fa-f759-4cb8-a7cf-1c6b6abb5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:54.612704 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace84fa-f759-4cb8-a7cf-1c6b6abb5751 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.612987 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace84fa-f759-4cb8-a7cf-1c6b6abb5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.613261 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace84fa-f759-4cb8-a7cf-1c6b6abb5751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.614088 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace84fa-f759-4cb8-a7cf-1c6b6abb5751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:54.615682 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace84fa-f759-4cb8-a7cf-1c6b6abb5751 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:54.626548 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1450/2892] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:03:54.630878 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:54.641492 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded8c9-608a-4437-b4b7-8dd4d0114e87 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:54.646536 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:54.647460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.647873 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.648192 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] PATH_INFO: `/v3/projects/bb95e8ac15bf4c0197e88235acdd08a4/users/cefe233f7c894374af6e8f4e57f12061/roles/59754b7a88d744b39ff76e3b857aeebc` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.650239 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb95e8ac15bf4c0197e88235acdd08a4, user_id=cefe233f7c894374af6e8f4e57f12061, role_id=59754b7a88d744b39ff76e3b857aeebc)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:54.652907 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:54.664062 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1443/2893] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:03:54 2022] PUT /identity/v3/projects/bb95e8ac15bf4c0197e88235acdd08a4/users/cefe233f7c894374af6e8f4e57f12061/roles/59754b7a88d744b39ff76e3b857aeebc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:03:54.674751 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571efcb-5d11-45db-acf5-8f2c9cb7410e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.675044 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571efcb-5d11-45db-acf5-8f2c9cb7410e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.675322 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571efcb-5d11-45db-acf5-8f2c9cb7410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.825529 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f571efcb-5d11-45db-acf5-8f2c9cb7410e None None] MFA Rules not processed for user `cefe233f7c894374af6e8f4e57f12061`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:03:54.826778 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f571efcb-5d11-45db-acf5-8f2c9cb7410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:54.848776 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:03:54.896942 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1451/2894] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:03:54.908545 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:54.910247 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:03:54.968941 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29786372-e0ef-48d3-ba09-5ad489b450bb admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:54.972496 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:54.973305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:54.973591 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:54.973902 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:54.983767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:54.985197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:54.994992 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1444/2895] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:03:55.210564 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571efcb-5d11-45db-acf5-8f2c9cb7410e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:03:55.220463 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571efcb-5d11-45db-acf5-8f2c9cb7410e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:03:55.223965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45aed-c112-4590-a7b9-1acffcc00bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:03:55.224808 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45aed-c112-4590-a7b9-1acffcc00bae service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:03:55.224949 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45aed-c112-4590-a7b9-1acffcc00bae service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:03:55.225165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45aed-c112-4590-a7b9-1acffcc00bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:03:55.280883 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45aed-c112-4590-a7b9-1acffcc00bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:03:55.282348 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45aed-c112-4590-a7b9-1acffcc00bae service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:03:55.291996 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1452/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:03:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:04:00.106627 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:00.169046 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198651aa-4152-41ab-8b01-95a772408ccd service cinder] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:00.173624 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:00.174506 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:00.174784 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:00.175055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] PATH_INFO: `/v3/users/9c80cb1e22cb4a5da0bc7e5a192b3539` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:00.176224 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c80cb1e22cb4a5da0bc7e5a192b3539)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:00.178197 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:00.379767 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:00.386217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c80cb1e22cb4a5da0bc7e5a192b3539'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:00.386883 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c80cb1e22cb4a5da0bc7e5a192b3539'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:00.398801 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c80cb1e22cb4a5da0bc7e5a192b3539'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:00.405459 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c80cb1e22cb4a5da0bc7e5a192b3539'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:00.408444 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c80cb1e22cb4a5da0bc7e5a192b3539'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:00.502568 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1445/2897] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:04:00 2022] DELETE /identity/v3/users/9c80cb1e22cb4a5da0bc7e5a192b3539 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:00.507765 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:00.508346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:00.508461 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:00.525522 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:00.526747 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:00.589066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1453/2898] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:00.598732 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:00.600166 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:00.658149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf3890-6dfb-4c48-8914-1cce336aea11 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:00.661693 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:00.662350 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:00.662638 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:00.663431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:00.672864 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:00.674434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:00.684779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1446/2899] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:04:01.111057 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:01.112906 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:01.125955 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f0025-9636-4e02-90ef-840d92781a95 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:01.130964 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:01.135137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:01.135137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:01.135137 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] PATH_INFO: `/v3/projects/0a38acc32e3041b4a1b8df2855249167` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:01.135674 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a38acc32e3041b4a1b8df2855249167)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:01.137360 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:01.241666 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a38acc32e3041b4a1b8df2855249167', 'request_id': 'req-31e783e3-eb60-4030-a9d4-9443b48f559b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.245373 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:01.314769 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a38acc32e3041b4a1b8df2855249167', 'request_id': 'req-31e783e3-eb60-4030-a9d4-9443b48f559b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.321320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a38acc32e3041b4a1b8df2855249167', 'request_id': 'req-31e783e3-eb60-4030-a9d4-9443b48f559b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.332948 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] The token cache is being invalidate because project 0a38acc32e3041b4a1b8df2855249167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:04:01.334028 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.334878 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.337149 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1454/2900] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:04:01 2022] DELETE /identity/v3/projects/0a38acc32e3041b4a1b8df2855249167 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:01.341057 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:01.351162 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4e17-ccc0-4afb-b24a-f4815db2b397 service neutron] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:01.408161 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:01.409030 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:01.409309 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:01.409584 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] PATH_INFO: `/v3/users/cefe233f7c894374af6e8f4e57f12061` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:01.410816 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefe233f7c894374af6e8f4e57f12061)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:01.412736 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:01.648794 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefe233f7c894374af6e8f4e57f12061'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.649522 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefe233f7c894374af6e8f4e57f12061'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.660469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:01.662781 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefe233f7c894374af6e8f4e57f12061'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.669747 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefe233f7c894374af6e8f4e57f12061'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.670434 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-d0650cc0-96fb-4453-ba78-0c44272f7b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefe233f7c894374af6e8f4e57f12061'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:01.760428 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1447/2901] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:04:01 2022] DELETE /identity/v3/users/cefe233f7c894374af6e8f4e57f12061 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:02.150536 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:02.152006 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:02.165733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e783e3-eb60-4030-a9d4-9443b48f559b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:02.222943 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:02.223804 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.224091 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.224369 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] PATH_INFO: `/v3/projects/bb95e8ac15bf4c0197e88235acdd08a4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.225614 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb95e8ac15bf4c0197e88235acdd08a4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:02.227646 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:02.322156 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb95e8ac15bf4c0197e88235acdd08a4', 'request_id': 'req-e823c900-783b-4e6a-beb4-24ee7062ea9c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:02.405879 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb95e8ac15bf4c0197e88235acdd08a4', 'request_id': 'req-e823c900-783b-4e6a-beb4-24ee7062ea9c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:02.412067 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb95e8ac15bf4c0197e88235acdd08a4', 'request_id': 'req-e823c900-783b-4e6a-beb4-24ee7062ea9c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:02.423852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] The token cache is being invalidate because project bb95e8ac15bf4c0197e88235acdd08a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:04:02.424148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:02.424784 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e823c900-783b-4e6a-beb4-24ee7062ea9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:02.426356 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1455/2902] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:04:02 2022] DELETE /identity/v3/projects/bb95e8ac15bf4c0197e88235acdd08a4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:02.432532 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302bd5-b0d8-489d-976f-d6c5e6b3b42e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.433055 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302bd5-b0d8-489d-976f-d6c5e6b3b42e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.433164 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302bd5-b0d8-489d-976f-d6c5e6b3b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.452691 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-60302bd5-b0d8-489d-976f-d6c5e6b3b42e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:02.454024 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-60302bd5-b0d8-489d-976f-d6c5e6b3b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:02.515175 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1448/2903] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:02.523246 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40985047-6c95-4b59-8c16-d04194dd1848 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.524289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40985047-6c95-4b59-8c16-d04194dd1848 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.524401 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40985047-6c95-4b59-8c16-d04194dd1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.543595 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-40985047-6c95-4b59-8c16-d04194dd1848 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:02.544830 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-40985047-6c95-4b59-8c16-d04194dd1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:02.553291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1456/2904] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:02.557520 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302bd5-b0d8-489d-976f-d6c5e6b3b42e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:02.567460 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302bd5-b0d8-489d-976f-d6c5e6b3b42e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:02.572073 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:02.572779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.573013 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.573293 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.574064 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 09:04:02.574372 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:02.575985 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:02.588069 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1449/2905] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 09:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 09:04:02.592345 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40985047-6c95-4b59-8c16-d04194dd1848 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:02.602445 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40985047-6c95-4b59-8c16-d04194dd1848 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:02.607071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:02.607713 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.607994 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.608267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.608962 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:02.610885 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:02.704848 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1457/2906] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:04:02 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 09:04:02.709002 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:02.719916 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942789-aa45-489e-89b8-5def044cfea7 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:02.776369 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:02.777041 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.777327 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.777607 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] PATH_INFO: `/v3/users` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.778334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:02.780305 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:02.875063 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1450/2907] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:04:02 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 09:04:02.879291 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:02.890249 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb39ca-c44a-4aff-abcc-ddcca4a43075 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:02.894871 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:02.895526 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.895812 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.896085 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.896805 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:02.899065 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:02.909334 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1458/2908] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:04:02.913433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:02.923976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c803f8-7cfb-422e-a71c-afff4db20e7e admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:02.928779 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574e776-ba43-4f8e-afa7-9ba39f393bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:02.929445 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574e776-ba43-4f8e-afa7-9ba39f393bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.929799 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574e776-ba43-4f8e-afa7-9ba39f393bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.930086 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574e776-ba43-4f8e-afa7-9ba39f393bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.930824 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574e776-ba43-4f8e-afa7-9ba39f393bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:02.932431 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574e776-ba43-4f8e-afa7-9ba39f393bf5 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:02.942682 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1451/2909] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:04:02.947257 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:02.957416 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42fdec-1a0a-4c55-9e6a-963352d7f24a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:02.962867 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:02.963749 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:02.964036 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:02.964315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] PATH_INFO: `/v3/projects/58e685f2610b4b9b8c9d1a6b7b855d34/users/84e58e3e099c40329f79f419c3002253/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:02.979549 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e685f2610b4b9b8c9d1a6b7b855d34, user_id=84e58e3e099c40329f79f419c3002253, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:02.982231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:03.034395 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1459/2910] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:04:02 2022] PUT /identity/v3/projects/58e685f2610b4b9b8c9d1a6b7b855d34/users/84e58e3e099c40329f79f419c3002253/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:03.049514 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938e9f9-9388-4461-b299-f63419951eec None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:03.049906 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938e9f9-9388-4461-b299-f63419951eec None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:03.050242 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938e9f9-9388-4461-b299-f63419951eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:03.078745 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-c938e9f9-9388-4461-b299-f63419951eec None None] MFA Rules not processed for user `84e58e3e099c40329f79f419c3002253`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:03.080058 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c938e9f9-9388-4461-b299-f63419951eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:03.112485 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:03.145727 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1452/2911] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:03.157418 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:03.159272 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:03.169722 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:03.239084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b7a13-849a-4e54-bb1b-0c5a9c6511dc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:03.243378 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec22f82d0e7745f282c5837459fba05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:03.244027 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:03.244310 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:03.244587 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:03.252912 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:03.254480 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:03.264454 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1460/2912] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:04:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:04:13.222588 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=12 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:13.290924 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=32 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:25.448397 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938e9f9-9388-4461-b299-f63419951eec None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:25.450456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-c938e9f9-9388-4461-b299-f63419951eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:25.556012 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938e9f9-9388-4461-b299-f63419951eec None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:25.562841 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bf54b-d03d-4928-92ea-12c9943e6135 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:25.563491 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bf54b-d03d-4928-92ea-12c9943e6135 service placement] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:25.563778 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bf54b-d03d-4928-92ea-12c9943e6135 service placement] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:25.564053 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bf54b-d03d-4928-92ea-12c9943e6135 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:25.565870 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-9c1bf54b-d03d-4928-92ea-12c9943e6135 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:25.578408 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bf54b-d03d-4928-92ea-12c9943e6135 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:25.580005 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bf54b-d03d-4928-92ea-12c9943e6135 service placement] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:25.590551 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1453/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:04:30.293508 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:30.355610 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40600abd-4f9e-4fcf-b820-201e05e73f06 service glance] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:30.361103 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:30.362005 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:30.362289 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:30.362566 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] PATH_INFO: `/v3/users/84e58e3e099c40329f79f419c3002253` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:30.363750 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e58e3e099c40329f79f419c3002253)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:30.365695 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:30.596083 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e58e3e099c40329f79f419c3002253'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:30.596771 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e58e3e099c40329f79f419c3002253'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:30.609950 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e58e3e099c40329f79f419c3002253'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:30.616870 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e58e3e099c40329f79f419c3002253'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:30.617559 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e58e3e099c40329f79f419c3002253'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:30.702076 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1461/2914] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:04:30 2022] DELETE /identity/v3/users/84e58e3e099c40329f79f419c3002253 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:30.706620 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:30.707113 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:30.707222 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:30.726144 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:30.727352 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:30.786122 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1454/2915] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:30.796684 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:30.798165 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:30.860795 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9fbf-feb8-43b3-b758-0c7f39472672 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:30.864353 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c70e5-242d-4d7a-9d33-06304dae1829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:30.864998 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c70e5-242d-4d7a-9d33-06304dae1829 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:30.865287 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c70e5-242d-4d7a-9d33-06304dae1829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:30.865562 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c70e5-242d-4d7a-9d33-06304dae1829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:30.875306 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c70e5-242d-4d7a-9d33-06304dae1829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:30.876733 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c70e5-242d-4d7a-9d33-06304dae1829 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:30.886114 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1462/2916] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:04:31.282048 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:31.284511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:31.295807 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c93cb-5100-4580-8566-5f34ebce9e27 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:31.301529 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:31.302900 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.303191 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.303469 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] PATH_INFO: `/v3/projects/58e685f2610b4b9b8c9d1a6b7b855d34` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.305547 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e685f2610b4b9b8c9d1a6b7b855d34)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:31.309974 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:31.410605 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e685f2610b4b9b8c9d1a6b7b855d34', 'request_id': 'req-a47b5c78-3d66-4243-a596-6ce4147e4abd'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:31.415980 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e685f2610b4b9b8c9d1a6b7b855d34', 'request_id': 'req-a47b5c78-3d66-4243-a596-6ce4147e4abd'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:31.422228 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e685f2610b4b9b8c9d1a6b7b855d34', 'request_id': 'req-a47b5c78-3d66-4243-a596-6ce4147e4abd'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:31.424952 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:31.490049 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] The token cache is being invalidate because project 58e685f2610b4b9b8c9d1a6b7b855d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:04:31.490334 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:31.490946 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-a47b5c78-3d66-4243-a596-6ce4147e4abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:31.492473 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1455/2917] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:04:31 2022] DELETE /identity/v3/projects/58e685f2610b4b9b8c9d1a6b7b855d34 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:31.498320 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43c07-52aa-497d-b12f-703988caae3d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.498866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43c07-52aa-497d-b12f-703988caae3d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.498866 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43c07-52aa-497d-b12f-703988caae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.518500 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cdd43c07-52aa-497d-b12f-703988caae3d None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:31.519710 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cdd43c07-52aa-497d-b12f-703988caae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:31.538567 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:31.582971 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1463/2918] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:31.591730 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d54d69-c111-40e2-b35f-8552aec4b851 None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.592021 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d54d69-c111-40e2-b35f-8552aec4b851 None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.592343 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d54d69-c111-40e2-b35f-8552aec4b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.610738 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-b8d54d69-c111-40e2-b35f-8552aec4b851 None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:31.611943 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-b8d54d69-c111-40e2-b35f-8552aec4b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:31.619948 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1456/2919] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:31.624732 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd43c07-52aa-497d-b12f-703988caae3d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:31.634392 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd43c07-52aa-497d-b12f-703988caae3d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:31.639781 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:31.640425 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.640706 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.641009 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.641755 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 09:04:31.642059 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:31.643640 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:31.655282 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1464/2920] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 09:04:31.659519 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d54d69-c111-40e2-b35f-8552aec4b851 None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:31.668677 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d54d69-c111-40e2-b35f-8552aec4b851 None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:31.673474 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:31.674158 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.674443 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.674717 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] PATH_INFO: `/v3/projects` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.675398 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:31.677301 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:31.760791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1457/2921] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 09:04:31 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 09:04:31.771106 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:31.781884 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19683e45-f2cd-4673-8e48-7816dc9e7813 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:31.838276 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:31.838874 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.839158 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.839436 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.840148 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:31.842185 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:31.942895 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1465/2922] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 09:04:31 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 09:04:31.947365 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:31.957975 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41209-1a24-4bf3-8579-30e0c75ebdba admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:31.962631 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:31.963292 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.963579 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.963894 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.964626 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:31.966331 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:31.976642 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1458/2923] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:04:31.980565 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:31.991267 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0680fe-48df-416f-b53f-02ee6a194fce admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:31.996024 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809fc57-796d-4e6b-8574-d59670d9bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:31.997402 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809fc57-796d-4e6b-8574-d59670d9bf95 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:31.997730 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809fc57-796d-4e6b-8574-d59670d9bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:31.998017 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809fc57-796d-4e6b-8574-d59670d9bf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:31.998744 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809fc57-796d-4e6b-8574-d59670d9bf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:32.000335 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809fc57-796d-4e6b-8574-d59670d9bf95 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:32.010278 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1466/2924] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 09:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 09:04:32.014513 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:32.024387 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aee1c3-13b8-4d8e-9364-8b8c4213fe30 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:32.029065 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:32.029976 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:32.030265 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:32.030546 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] PATH_INFO: `/v3/projects/39226ef19de54490b3b58ebe07a52ebd/users/e09419a02b9f4db1a73b7d4cabe311ec/roles/6364bdd7a64e476ba4944148f2453c0b` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:32.045503 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39226ef19de54490b3b58ebe07a52ebd, user_id=e09419a02b9f4db1a73b7d4cabe311ec, role_id=6364bdd7a64e476ba4944148f2453c0b)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:32.048494 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:32.114149 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1459/2925] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 09:04:32 2022] PUT /identity/v3/projects/39226ef19de54490b3b58ebe07a52ebd/users/e09419a02b9f4db1a73b7d4cabe311ec/roles/6364bdd7a64e476ba4944148f2453c0b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:32.124760 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94521670-10c3-45b7-91d1-12a23db36420 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:32.125060 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94521670-10c3-45b7-91d1-12a23db36420 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:32.125349 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94521670-10c3-45b7-91d1-12a23db36420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:32.152099 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-94521670-10c3-45b7-91d1-12a23db36420 None None] MFA Rules not processed for user `e09419a02b9f4db1a73b7d4cabe311ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:32.154066 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-94521670-10c3-45b7-91d1-12a23db36420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:32.217084 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1467/2926] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:32.227961 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:32.229753 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:32.287521 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b41570-49c0-4144-a278-29414d51d957 admin admin] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:32.291189 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a4aa6-7119-46f3-8d30-19416a8ed409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d2f745ac2a4388a7890250141a4e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:32.291832 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a4aa6-7119-46f3-8d30-19416a8ed409 service cinder] REQUEST_METHOD: `GET` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:32.292497 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a4aa6-7119-46f3-8d30-19416a8ed409 service cinder] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:32.292783 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a4aa6-7119-46f3-8d30-19416a8ed409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:32.301973 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a4aa6-7119-46f3-8d30-19416a8ed409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:32.303488 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a4aa6-7119-46f3-8d30-19416a8ed409 service cinder] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:32.312569 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1460/2927] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:04:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:04:42.214071 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:42.308217 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:43.617725 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94521670-10c3-45b7-91d1-12a23db36420 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:43.677789 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94521670-10c3-45b7-91d1-12a23db36420 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:43.682305 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:43.683421 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:43.683698 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:43.683965 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] PATH_INFO: `/v3/users/e09419a02b9f4db1a73b7d4cabe311ec` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:43.685162 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09419a02b9f4db1a73b7d4cabe311ec)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:43.687632 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:43.910226 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09419a02b9f4db1a73b7d4cabe311ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:43.910916 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09419a02b9f4db1a73b7d4cabe311ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:43.923711 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09419a02b9f4db1a73b7d4cabe311ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:43.930544 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09419a02b9f4db1a73b7d4cabe311ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:43.931219 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09419a02b9f4db1a73b7d4cabe311ec'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:44.004826 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1468/2928] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 09:04:43 2022] DELETE /identity/v3/users/e09419a02b9f4db1a73b7d4cabe311ec => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:44.009324 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] REQUEST_METHOD: `POST` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:44.009829 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:44.009958 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:44.028066 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.auth.core [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] MFA Rules not processed for user `ab4196857ae341bbac204680cc59c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 09:04:44.029286 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:44.088311 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1461/2929] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 09:04:44.098315 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:44.099729 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:44.157250 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaf9ac-b81b-4f7b-b98a-cb416ee1022b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:44.160856 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b40cb94150444c81ab1de3c6c1c1ed7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:44.161437 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:44.161767 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:44.162833 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:44.171913 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:44.173346 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:44.183043 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1469/2930] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:04:44.608433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] Authenticating user token {{(pid=80328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:04:44.608433 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.fernet_utils [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:04:44.624308 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2badd4-b5de-460f-8507-42b0e873c15e None None] Validating token access rules against request {{(pid=80328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:04:44.630375 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4196857ae341bbac204680cc59c0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab95a2af933c40dba08b776a8568e994', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:04:44.631245 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:04:44.631511 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:04:44.631791 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] PATH_INFO: `/v3/projects/39226ef19de54490b3b58ebe07a52ebd` {{(pid=80328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:04:44.633132 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=39226ef19de54490b3b58ebe07a52ebd)` {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:04:44.635084 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] RBAC: Authorization granted {{(pid=80328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:04:44.736136 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39226ef19de54490b3b58ebe07a52ebd', 'request_id': 'req-3d1470ff-848d-4816-b997-df5e083175ed'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:44.741654 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39226ef19de54490b3b58ebe07a52ebd', 'request_id': 'req-3d1470ff-848d-4816-b997-df5e083175ed'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:44.747808 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39226ef19de54490b3b58ebe07a52ebd', 'request_id': 'req-3d1470ff-848d-4816-b997-df5e083175ed'} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:44.833456 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] The token cache is being invalidate because project 39226ef19de54490b3b58ebe07a52ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80328) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 09:04:44.833850 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:44.834411 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG keystone.notifications [None req-3d1470ff-848d-4816-b997-df5e083175ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80328) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 09:04:44.836009 dv-cinder-850142-3-smb devstack@keystone.service[80328]: [pid: 80328|app: 0|req: 1462/2931] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 09:04:44 2022] DELETE /identity/v3/projects/39226ef19de54490b3b58ebe07a52ebd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 09:04:54.178598 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:04:54.830129 dv-cinder-850142-3-smb devstack@keystone.service[80328]: DEBUG dbcounter [-] [80328] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:09:30.963810 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 09:09:30.965231 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:09:31.033852 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3bef3-12a0-451e-9300-ee4bb0c44600 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 09:09:31.090785 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a40b2f-6861-4cd0-81db-9a3de26bd40c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbf155ccbb14c9b908a9077555feadf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe4dd7d0ee5d4694b99bf22f5be513dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 09:09:31.091995 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a40b2f-6861-4cd0-81db-9a3de26bd40c service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 09:09:31.092281 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a40b2f-6861-4cd0-81db-9a3de26bd40c service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 09:09:31.092556 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a40b2f-6861-4cd0-81db-9a3de26bd40c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 09:09:31.094366 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c3a40b2f-6861-4cd0-81db-9a3de26bd40c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 09:09:31.105325 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a40b2f-6861-4cd0-81db-9a3de26bd40c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 09:09:31.107004 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a40b2f-6861-4cd0-81db-9a3de26bd40c service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 09:09:31.116773 dv-cinder-850142-3-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1470/2932] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 09:09:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 09:09:41.112485 dv-cinder-850142-3-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=58 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}